gothenburgtimes.com
robots.txt

Robots Exclusion Standard data for gothenburgtimes.com

Resource Scan

Scan Details

Site Domain gothenburgtimes.com
Base Domain gothenburgtimes.com
Scan Status Ok
Last Scan2024-10-13T19:04:43+00:00
Next Scan 2024-11-12T19:04:43+00:00

Last Scan

Scanned2024-10-13T19:04:43+00:00
URL https://gothenburgtimes.com/robots.txt
Redirect https://tidrc.com/robots.txt
Redirect Domain tidrc.com
Redirect Base tidrc.com
Domain IPs 104.21.34.110, 172.67.159.165, 2606:4700:3030::ac43:9fa5, 2606:4700:3035::6815:226e
Redirect IPs 104.21.95.227, 172.67.171.129, 2606:4700:3031::6815:5fe3, 2606:4700:3035::ac43:ab81
Response IP 172.67.171.129
Found Yes
Hash 171c1a1bb373450cc97850a7ea4cdb52d9134c46d6f8ed4f424a99f58c3f19a5
SimHash 6950dc56c711

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://tidrc.com/sitemap.xml