spacetransportation.org
robots.txt
Robots Exclusion Standard data for spacetransportation.org
Resource Scan
Scan Details
Site Domain | spacetransportation.org |
Base Domain | spacetransportation.org |
Scan Status | Ok |
Last Scan | 2024-11-12T22:37:45+00:00 |
Next Scan | 2024-12-12T22:37:45+00:00 |
Last Scan
Scanned | 2024-11-12T22:37:45+00:00 |
URL | https://spacetransportation.org/robots.txt |
Redirect | https://topsidepress.com/robots.txt |
Redirect Domain | topsidepress.com |
Redirect Base | topsidepress.com |
Domain IPs | 104.21.40.17, 172.67.174.129, 2606:4700:3033::ac43:ae81, 2606:4700:3035::6815:2811 |
Redirect IPs | 104.21.72.208, 172.67.154.251, 2606:4700:3034::ac43:9afb, 2606:4700:3037::6815:48d0 |
Response IP | 104.21.72.208 |
Found | Yes |
Hash | 3699d7f4d6414dd046f9c2222aa9f50edd3678904834825d093cd35d38aaac59 |
SimHash | 09135391c7d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /tmp/ |
Allow | /*.jpg$ |
Allow | /*.jpeg$ |
Allow | /*.gif$ |
Allow | /*.png$ |
Allow | /*.webp$ |
Other Records
Field | Value |
---|---|
sitemap | https://topsidepress.com/sitemap.xml |
Warnings
- 2 invalid lines.