Scheduled tasks

This documentation is only visible to GBIF staff.

Production cluster

All times are in UTC! (Oozie runs in UTC, so if relevant they should fit around +1 and +2 for our working hours.)

  • 17:00 Working day in Copenhagen has ended, this is 18h in winter and 19h in summer

  • 18:00 Map points tiles, takes 20 minutes

  • 19:00 Map pyramid tiles, takes 5-6 hours (finishing 00-01)

  • 20:00

  • 21:00

  • 22:00

  • 23:00

  • 00:00

  • 01:00

  • 02:00 Map points tiles, takes 20 minutes

  • 03:00 (Thursdays only) Gridded datasets

  • 04:00 Map points tiles, takes 20 minutes

  • 05:00 Avro→HDFS occurrence table build, takes about 1 hour.

  • 06:00 Map points tiles, takes 20 minutes

  • 07:00 (Mondays only) GRSciColl cache rebuild; everyday Clustering run (2-3hrs with 400 cores)

  • 08:00 Map points tiles, takes 20 minutes

  • 09:00

  • 10:00 Map points tiles, takes 20 minutes

  • 11:00

  • 12:00 Map points tiles, takes 20 minutes

  • 13:00

  • 14:00 Map points tiles, takes 20 minutes

  • 15:00

  • 16:00 Map points tiles, takes 20 minutes