towleroad.com
robots.txt

Robots Exclusion Standard data for towleroad.com

Resource Scan

Scan Details

Site Domain towleroad.com
Base Domain towleroad.com
Scan Status Ok
Last Scan2024-05-17T09:23:42+00:00
Next Scan 2024-05-24T09:23:42+00:00

Last Scan

Scanned2024-05-17T09:23:42+00:00
URL https://towleroad.com/robots.txt
Redirect https://www.towleroad.com/robots.txt
Redirect Domain www.towleroad.com
Redirect Base towleroad.com
Domain IPs 162.159.135.42
Redirect IPs 162.159.135.42
Response IP 162.159.135.42
Found Yes
Hash a4e6d151b50e3e238b8ee0a018fd1b4f0e57fc0a83a339e5a78e49c5015103d1
SimHash 690048004db3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.towleroad.com/sitemap_index.xml