thetechheadlines.com
robots.txt

Robots Exclusion Standard data for thetechheadlines.com

Resource Scan

Scan Details

Site Domain thetechheadlines.com
Base Domain thetechheadlines.com
Scan Status Ok
Last Scan2025-11-23T01:37:12+00:00
Next Scan 2025-11-30T01:37:12+00:00

Last Scan

Scanned2025-11-23T01:37:12+00:00
URL https://thetechheadlines.com/robots.txt
Domain IPs 45.76.1.138
Response IP 45.76.1.138
Found Yes
Hash 620a2c90ada48a16a90646a34f3f6dc86b8a8df426a45ad0d0980fef2408d513
SimHash eb188cf2e213

Groups

*
ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3600

Other Records

Field Value
sitemap https://thetechheadlines.com/sitemap_index.xml