epsteinsuite.com
robots.txt
Robots Exclusion Standard data for epsteinsuite.com
Resource Scan
Scan Details
| Site Domain | epsteinsuite.com |
| Base Domain | epsteinsuite.com |
| Scan Status | Ok |
| Last Scan | 2026-03-19T10:28:58+00:00 |
| Next Scan | 2026-03-26T10:28:58+00:00 |
Last Scan
| Scanned | 2026-03-19T10:28:58+00:00 |
| URL | https://epsteinsuite.com/robots.txt |
| Domain IPs | 104.21.76.161, 172.67.197.118, 2606:4700:3031::ac43:c576, 2606:4700:3035::6815:4ca1 |
| Response IP | 172.67.197.118 |
| Found | Yes |
| Hash | 80000f9c3a31d7dc36bc88abdae8bc388680f7ccf8f99bc54ced247d76d73005 |
| SimHash | 63384e02e551 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /scripts/ |
| Disallow | /config/ |
| Disallow | /cache/ |
| Disallow | /storage/ |
| Disallow | /includes/ |
| Disallow | /api/ |
| Disallow | /developer/ |
| Disallow | /serve.php |
| Disallow | /video_thumb.php |
| Disallow | /ingestion_progress.php |
| Disallow | /debug_cli.php |
| Disallow | /debug_serve.php |
| Disallow | /test_db.php |
| Disallow | /audit_manual_uploads.php |
| Disallow | /get_missing_list.php |
| Disallow | /list_storage.php |
| Disallow | /register_docs.php |
| Disallow | /ai_summary_status.php |
| Disallow | /check_ |
| Disallow | /migrate |
| Disallow | /update_flight_schema.php |
| Disallow | /*?*page= |
| Disallow | /*?*sort= |
| Disallow | /*?*p= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
gptbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /developer/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://epsteinsuite.com/sitemap.xml |
Comments