DANDI - investigation of S3 bucket usage - 2024-11-07
| Bucket | Objects | Size | Notes | Disposition |
|---|---|---|---|---|
| backup.girder.dandiarchive.org | 0 | 0 | don't know what this was for | delete |
| dandi-api-staging-dandiset-logs | 656K | 10GB | archived access logs for staging | delete or lifecycle rule (but confirm with Yarik) |
| dandi-api-staging-dandisets | 1.7M | 6.6TB | dandiset asset storage for staging | keep |
| dandi-api-staging-embargo-dandisets | 1276 | 722GB | obsolete storage for embargoed dandisets on staging | delete (but confirm with Jake) |
| dandi-api-staging-embargo-dandisets-logs | 14K | 133MB | archived access logs for embargoed staging | delete or lifecycle rule (but confirm with Yarik) |
| dandi-api-staging-storage | 0 | 0 | don't know what this is for | delete |
| dandi-api-storage | 0 | 0 | don't know what this is for | delete |
| dandi-archive-admin | 6 | 1.5GB | db backups and other artifacts needed for operations & maintenance | keep |
| dandi-jake-test-bucket | 9529 | 770GB | test bucket for sensitive feature (embargo?); confirm with Jake | delete (but confirm with Jake) |
| dandi-jake-test-bucket-embargoed | 1036 | 512GB | test bucket for sensitive feature (embargo?); confirm with Jake | delete (but confirm with Jake) |
| dandi-s3-experiment-bucket | 1 | 73B | test bucket for trailing delete lifecycle rules; confirm with Mike | delete (but confirm with Mike) |
| dandi-search-llm-bucket | 6 | 2KB | LLM experiment results | don't know; discuss with Satra and Yarik |
| dandi-test-data | 1 | 3.9KB | unknown | don't know; discuss with Satra and Yarik |
| dandihub-s3 | 1390 | 505MB | storage for dandihub?; confirm with Austin | keep (but confirm with Austin) |
| dandihub-staging-tfstate | 1 | 170KB | Terraform state storage for dandihub | delete (but confirm with Austin) |
| eks-dandihub-tfstate | 1 | 550KB | Terraform state storage for EKS | delete (but confirm with Austin) |
| elasticbeanstalk-us-east-1-278212569472 | 45 | 22MB | LLM search app? | don't know; discuss with Satra and Yarik |
| elasticbeanstalk-us-west-2-278212569472 | 0 | 0 | unknown | delete (but confirm with Satra and Yarik) |
| mumble-melody | 1556 | 17.6GB | lots of zip files; no idea what they're for | don't know; discuss with Satra and Yarik |