washingtoncitypaper.com
robots.txt

Robots Exclusion Standard data for washingtoncitypaper.com

Resource Scan

Scan Details

Site Domain washingtoncitypaper.com
Base Domain washingtoncitypaper.com
Scan Status Ok
Last Scan2024-11-02T09:41:06+00:00
Next Scan 2024-11-09T09:41:06+00:00

Last Scan

Scanned2024-11-02T09:41:06+00:00
URL https://washingtoncitypaper.com/robots.txt
Domain IPs 192.0.78.24, 192.0.78.25
Response IP 192.0.78.25
Found Yes
Hash bc361334d622c33e3af9b95aa71ec43d255e25a4f9ad448797aa479af88a06bf
SimHash 6845c9d48993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gigabot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

muckrack

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

googlebot

Rule Path
Disallow /events/
Disallow /event/

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://washingtoncitypaper.com/wp-sitemap.xml