Cloud Run Jobs Demos - A collection of samples to show you how and when to run a container to completion without a server

Related tags

Job Queues jobs-demos
Overview

Cloud Run Jobs Demo Applications

Cloud Run Jobs allows you to run a container to completion without a server.

This repository contains a collection of samples for Jobs for various use cases.

Samples

Sample Description
Screenshot Create a Cloud Run job to take screenshots of web pages.
User Journey Replayer Replay recorded user journeys of your website on Cloud Run jobs.

Contributing changes

Entirely new samples are not accepted. Bug fixes are welcome, either as pull requests or as GitHub issues.

See CONTRIBUTING.md for details on how to contribute.

Licensing

Code in this repository is licensed under the Apache 2.0. See LICENSE.

This is not an official Google product.

Comments
  • Update user-journeys shell scripts

    Update user-journeys shell scripts

    Small updates to the shell scripts based on trying them on my machine.

    cc @steren - unsure if /config was missing on your initial PR or intentionally not committed

    opened by glasnt 4
  • Sample not working as expected

    Sample not working as expected

    Hello

    I'm trying to run the sample as described in https://github.com/GoogleCloudPlatform/jobs-demos/tree/main/screenshot - I encountered following issues

    1. In the README the link to codelab is broken
    2. If I run the Create cloud run job command from the README, I get following error: ERROR: (gcloud.alpha.run.jobs.create) unrecognized arguments: --task-timeout=5m (did you mean '--http-timeout'?)
    3. If I remove the --task-timeout=5m, I get the following error ERROR: (gcloud.alpha.run.jobs.create) Namespaces instance [myproject] not found: Requested entity was not found.

    I was not able to solve the Namespace issue. Is there a additional required step which is missing? Thanks

    opened by LMSSonos 3
  • Always use latest Puppeteer Docker or use v19+

    Always use latest Puppeteer Docker or use v19+

    We fixed a npm cache issue in Puppeteer Docker. (see #9095) Prior to v19, this docker randomly failed due to npm cache permission. User needs to add additional chown on root user to workaround it. See previous syntax.

    The issue is fixed now. This Docker file will work as-is after upgrade to v19+

    opened by jecfish 2
  • Cleanup invoicing sample

    Cleanup invoicing sample

    Based on comments in #22

    • Add programatic firebase initialisation
    • Cleanup typos
    • Parameterise region
    • Misc formatting consistency

    @averikitsch for review

    opened by glasnt 1
  • Recommended edits to invoice-processing README

    Recommended edits to invoice-processing README

    Thanks for the great repo and accompanying video. In running through the invoice-processing-pipeline README, though, I found that I had to make two changes to make the job run successfully. I wanted to share them along with one additional recommendation:

    1. after initiating the Firestore database API, I still needed to go to the Firestore webpage to select between the native and datastore modes before the api would function. Perhaps you should add a bullet under the * Navigate to the Document AI section (also note the typo with 'the the')
    2. there is a missing '' in the second command in the "Create the Cloud Run Job" section. It should be --image gcr.io/$GOOGLE_CLOUD_PROJECT/invoice-processor \ otherwise the env variables aren't passed
    3. (recommendation) making the GCP region an env variable vs. hardcoded would make it easier to run this code in different parts of the world without typing over 'europe-west9'
    opened by seanofahey 0
  • user-journey-demo: task number should match user journey number

    user-journey-demo: task number should match user journey number

    README should say that number of tasks must match the number of user journeys.

    Install script should count the number of journeys and set up the appropriate number of tasks when creating the job

    opened by steren 0
  • user-journeys: Fail the container if an error occurs during replay

    user-journeys: Fail the container if an error occurs during replay

    It seems that if await runner.run(); returns an error, we are still displaying User journey N completed

    we should probably wrap this line around a try / catch

    opened by steren 1
Owner
Google Cloud Platform
Google Cloud Platform
GitHub
Job queues and scheduled jobs for Node.js, Beanstalkd and/or Iron.io.

Ironium Job queues and scheduled jobs for Node.js backed by Beanstalk/IronMQ/SQS. The Why You've got a workload that runs outside the Web app's reques

Assaf Arkin 71 Dec 14, 2022
Premium Queue package for handling distributed jobs and messages in NodeJS.

The fastest, most reliable, Redis-based queue for Node. Carefully written for rock solid stability and atomicity. Sponsors · Features · UIs · Install

null 13.5k Dec 31, 2022
Challenge [Frontend Mentor] - In this challenge, JavaScript was used to filter jobs based on the selected categories. Technologies used: HTML5, CSS3 and React.

Getting Started with Create React App This project was bootstrapped with Create React App. Available Scripts In the project directory, you can run: np

Rui Neto 11 Apr 13, 2022
Nodejs Background jobs using redis.

node-resque: The best background jobs in node. Distributed delayed jobs in nodejs. Resque is a background job system backed by Redis (version 2.6.0 an

Actionhero 1.2k Jan 3, 2023
Hello Jobs is a one-stop solution for all job seekers. In future, this could also serve as a platform for recruiters to hire potential candidates.

Hello Jobs Hello Jobs is a one-stop solution for all job seekers. In future, this could also serve as a platform for recruiters to hire potential cand

S Harshita 6 Dec 26, 2022
Use Cloudflare Workers Cron Triggers to keep your Hetzner Cloud Firewall allowing the latest list of Cloudflare IPs, or any other lists!

Hetzner Cloud Firewall automation with Cloudflare Workers Heavily inspired by xopez/Hetzner-Cloud-Firewall-API-examples, this repository holds a Cloud

Erisa A 9 Dec 17, 2022
Run scheduled tasks

Berkala Berkala runs scheduled tasks specified in a YAML-based configuration. To get started, first download the binary for your operating system from

Ariya Hidayat 31 Aug 12, 2022
A client-friendly run queue

client-run-queue This package provides a RunQueue implementation for scheduling and managing async or time-consuming functions such that client-side i

Passfolio 6 Nov 22, 2022
A Remix.run stack to monitor your BullMQ queues

Remix Matador stack A bold interface that helps you monitor your BullMQ queues. Learn more about Remix Stacks. $ npx create-remix@latest --template nu

Andrea 19 Dec 15, 2022
A client-friendly run queue

client-run-queue This package provides a RunQueue implementation for scheduling and managing async or time-consuming functions such that client-side i

Passfolio 4 Jul 5, 2022
Server and Browser code are really the same. It's magic.

Service Worker Magic Server (Cloudflare Workers) code is sw.js. Browser ( Service Worker ) code is sw.js. Cloudflare Workers sw.js serves sw.js. Servi

Yusuke Wada 19 Dec 9, 2022
This project demonstrates how you can use the multi-model capabilities of Redis to create a real-time stock watchlist application.

Introduction This project demonstrates how you can use Redis Stack to create a real-time stock watchlist application. It uses several different featur

Redis Developer 43 Jan 2, 2023
TypeScript Data Structures that you need!

TSDS TypeScript Data Structures that you need! Doc Website Introduction A data structure is a way to store and organize data in order to facilitate ac

Ehsan Samavati 25 Dec 8, 2022
Cloudflare Worker that will allow you to progressively migrate files from an S3-compatible object store to Cloudflare R2.

A Cloudflare Worker for Progressive S3 to R2 Blog Post: https://kian.org.uk/progressive-s3-to-cloudflare-r2-migration-using-workers/ This is a Cloudfl

Kian 29 Dec 30, 2022
A bot that notifies you on Slack whenever your company/product is mentioned on Hacker News. Powered by Vercel Functions & Upstash.

Hacker News Slack Bot A bot that notifies you on Slack whenever your company/product is mentioned on Hacker News. or deploy your own Built With Vercel

Vercel Labs 162 Jan 3, 2023
Bree is the best job scheduler for Node.js and JavaScript with cron, dates, ms, later, and human-friendly support.

The best job scheduler for Node.js and JavaScript with cron, dates, ms, later, and human-friendly support. Works in Node v10+ and browsers, uses workers to spawn sandboxed processes, and supports async/await, retries, throttling, concurrency, and graceful shutdown. Simple, fast, and lightweight. Made for @ForwardEmail and @ladjs.

Bree - The Best Node.js and JavaScript Job Scheduler 2.5k Dec 30, 2022
Type-safe and Promisified API for Web Worker and Iframe

?? You can help the author become a full-time open-source maintainer by sponsoring him on GitHub. typed-worker Install npm i typed-worker Usage Create

EGOIST 189 Dec 31, 2022
Redis-backed task queue engine with advanced task control and eventual consistency

idoit Redis-backed task queue engine with advanced task control and eventual consistency. Task grouping, chaining, iterators for huge ranges. Postpone

Nodeca 65 Dec 15, 2022
A fast, robust and extensible distributed task/job queue for Node.js, powered by Redis.

Conveyor MQ A fast, robust and extensible distributed task/job queue for Node.js, powered by Redis. Introduction Conveyor MQ is a general purpose, dis

Conveyor MQ 45 Dec 15, 2022