subscribe.washingtonpost.com
robots.txt

Robots Exclusion Standard data for subscribe.washingtonpost.com

Resource Scan

Scan Details

Site Domain subscribe.washingtonpost.com
Base Domain washingtonpost.com
Scan Status Ok
Last Scan2024-05-01T15:17:12+00:00
Next Scan 2024-05-31T15:17:12+00:00

Last Scan

Scanned2024-05-01T15:17:12+00:00
URL https://subscribe.washingtonpost.com/robots.txt
Domain IPs 173.222.144.137
Response IP 104.69.152.136
Found Yes
Hash 5d1bb2f03e9334be70c0f153cad2a666d9258ad5588d7fd0c99e2c371b0e6d84
SimHash 2573ef8376d7

Groups

*

Rule Path
Disallow /braintree/
Disallow /enterpriseportal/
Disallow /foryouapi/
Disallow /lagoon/
Disallow /logging/
Disallow /offers/service/
Disallow /onsiteapi/
Disallow /paywall/
Disallow /person/
Disallow /preferenceapi/
Disallow /subscriptionapi/
Disallow /user/

riverbot

Rule Path
Disallow /

Comments

  • Subscribe PROD
  • All bots rules
  • Specific bots rules