upload.datpiff.com
robots.txt

Robots Exclusion Standard data for upload.datpiff.com

Resource Scan

Scan Details

Site Domain upload.datpiff.com
Base Domain datpiff.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-01T14:39:17+00:00
Next Scan 2024-06-30T14:39:17+00:00

Last Successful Scan

Scanned2023-03-09T02:20:50+00:00
URL https://upload.datpiff.com/robots.txt
Domain IPs 34.120.75.13
Response IP 34.120.75.13
Found Yes
Hash fdf69572dddf867a7204d3a32d2c4baedb1ed1841016d7996b06abc134a57b17
SimHash e7b89055e537

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap http://www.datpiff.com/sitemap.xml
sitemap http://www.datpiff.com/sitemaps/mixtapes-by-month.xml