publishersglobal.com
robots.txt

Robots Exclusion Standard data for publishersglobal.com

Resource Scan

Scan Details

Site Domain publishersglobal.com
Base Domain publishersglobal.com
Scan Status Ok
Last Scan2024-10-03T18:58:14+00:00
Next Scan 2024-10-10T18:58:14+00:00

Last Scan

Scanned2024-10-03T18:58:14+00:00
URL https://publishersglobal.com/robots.txt
Redirect https://www.publishersglobal.com/robots.txt
Redirect Domain www.publishersglobal.com
Redirect Base publishersglobal.com
Domain IPs 104.21.75.108, 172.67.221.90, 2606:4700:3030::ac43:dd5a, 2606:4700:3035::6815:4b6c
Redirect IPs 104.21.75.108, 172.67.221.90, 2606:4700:3030::ac43:dd5a, 2606:4700:3035::6815:4b6c
Response IP 104.21.75.108
Found Yes
Hash d40a6f9d2773e7485a365fd4db04ce6a409b7dcc53d2512db90d79765d183b85
SimHash a29a99c57365

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file