cdn1.thecomeback.com
robots.txt

Robots Exclusion Standard data for cdn1.thecomeback.com

Resource Scan

Scan Details

Site Domain cdn1.thecomeback.com
Base Domain thecomeback.com
Scan Status Ok
Last Scan2024-05-25T13:17:23+00:00
Next Scan 2024-06-24T13:17:23+00:00

Last Scan

Scanned2024-05-25T13:17:23+00:00
URL https://cdn1.thecomeback.com/robots.txt
Domain IPs 128.1.35.170, 2400:52e0:1500::868:1
Response IP 138.199.46.68
Found Yes
Hash fe0a0449d02a7cc62b7108bc20a364d746150f8660d3eec8a36e7df51030fc36
SimHash 4034d5526603

Groups

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10