thecomeback.com
robots.txt

Robots Exclusion Standard data for thecomeback.com

Resource Scan

Scan Details

Site Domain thecomeback.com
Base Domain thecomeback.com
Scan Status Ok
Last Scan2024-05-29T01:00:31+00:00
Next Scan 2024-06-05T01:00:31+00:00

Last Scan

Scanned2024-05-29T01:00:31+00:00
URL https://thecomeback.com/robots.txt
Domain IPs 71.19.228.2
Response IP 71.19.228.2
Found Yes
Hash fe0a0449d02a7cc62b7108bc20a364d746150f8660d3eec8a36e7df51030fc36
SimHash 4034d5526603

Groups

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10