1.21.0 “Donkeys of the Galaxy”

Upgrade Instructions

This feature release requires a database schema upgrade. Please consult the documentation about upgrading your database schema.

The following changes are necessary and are covered by the alembic upgrade head command:

  1. Adding columns created_at and updated_at to did_meta table. This only needs to be executed if the columns are not existing (Alembic revision 53b479c3cb0f)

  2. Adding SAML as authentication typ to identities and account_map tables (Alembic revision 9a1b149a2044)

  3. Adding staging_started_at and staging_finished_at to requests and requests_history tables (Alembic revision bc68e9946deb)

  4. Adding third_party_copy_write and third_party_copy_read columns to rse_protocols table (Alembic revision 2b69addda658)

  5. Added new account_glob_limits table (Alembic revision a74275a1ad30)

  6. Added new dids_followed and dids_followed_events tables (Alembic revision 7541902bf173)

  7. Added strategy, direction, and deadline column to rse_transfer_limits table (Alembic revision 810a41685bc1)

General

Features

  • Core & Internals: Global account qutoas #2315

  • Core & Internals: Per-RSE checksum specification #2498

  • Core & Internals: Removal of fts3-rest-api dependency #2518

  • Core & Internals: Add Source rse mode to throttler #2611

  • Deletion: Use signed URLs when deleting from object stores #2411

  • Collection following mechanism #2304

  • Release management: Dependency upgrade for 1.21 #3054

  • Testing: flake8 and pycodestyles upgrade #2156

  • Testing: activate python3 client tests #2943

  • Transfers: Generic Multi-Hop transfers #2632

  • Transfers: Rucio support for Globus Online as a transfer tool #2905

  • Transfers: Add staging timestamps to request history #3023

  • WebUI: Login to WebUI with SSO #2306

  • WebUI: Create username/password authentication for Rucio WebUI #2614

Enhancements

  • Core & Internals: S3 URL signing code should pass endpoint to boto3 #2715

  • Core & Internals: S3 URL signing code should use RSE name to index credentials #2717

  • Core & Internals: session() replaced by Session() in requests #3011

  • Core & Internals: Add a quota_approver similar to rule_approver #3053

  • Infrastructure: Add objectstore to development Docker image #2855

  • Infrastructure: Add a docker-compose that brings services up only listening on localhost #2990

  • Testing: fix setup problems in python3 travis tests #2597

  • Testing: Activate grouped FIFO tests for mysql #2802

  • Testing: Python 3.* tests for clients #3032

  • Transfers: Minor improvements to MultiHop algorithm #3086

Bugs

  • Core & Internals: problems upgrading to latest mysql/mariadb version #2421

  • Core & Internals: Missing created_at and updated_at columns in did_meta table #2462

  • Core & Internals: Integer attribute value ‘1’ displayed as ‘True’ in the client. #2787

  • Core & Internals: missing dot in schema in alembic scripts #2823

  • Core & Internals: check global quota in running RSESelector #3070

  • Core & Internals: delete_replica query on archive_contents uses too many bind variables #3089

  • Infrastructure: docker setup issues #3038

  • Release management: alembic cli not working #2872

  • Transfers: Failure with multihop in case an intermediate request already exists #3078

  • Transfers: Keyword argument error in conveyor #3093

Clients

Bugs

  • Clients: rucio client fails if username not defined #3050