archive.thetab.com
robots.txt

Robots Exclusion Standard data for archive.thetab.com

Resource Scan

Scan Details

Site Domain archive.thetab.com
Base Domain thetab.com
Scan Status Ok
Last Scan2026-02-04T21:43:52+00:00
Next Scan 2026-03-06T21:43:52+00:00

Last Scan

Scanned2026-02-04T21:43:52+00:00
URL https://archive.thetab.com/robots.txt
Domain IPs 104.20.27.165, 172.66.146.228, 2606:4700:10::6814:1ba5, 2606:4700:10::ac42:92e4
Response IP 104.20.27.165
Found Yes
Hash 82c64973428e530b33dcff2e1d0b4f9d6402d9bbf507b14a280f69ab439eafb8
SimHash 6900dc40cbb0

Groups

*

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 1