devilstgirls.com
robots.txt

Robots Exclusion Standard data for devilstgirls.com

Resource Scan

Scan Details

Site Domain devilstgirls.com
Base Domain devilstgirls.com
Scan Status Ok
Last Scan2024-05-23T10:40:48+00:00
Next Scan 2024-06-22T10:40:48+00:00

Last Scan

Scanned2024-05-23T10:40:48+00:00
URL https://devilstgirls.com/robots.txt
Redirect https://www.devilstgirls.com/robots.txt
Redirect Domain www.devilstgirls.com
Redirect Base devilstgirls.com
Domain IPs 104.27.205.87, 104.27.206.87
Redirect IPs 104.27.205.87, 104.27.206.87
Response IP 104.27.205.87
Found Yes
Hash 914b73ddd74d22de734aa8f8abef4ae4f099ebf316d3d29b511bb1516fc4063b
SimHash c7110474e713

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.devilstgirls.com/sitemap/actor.xml
sitemap https://www.devilstgirls.com/sitemap/scene.xml
sitemap https://www.devilstgirls.com/sitemap/dvd.xml
sitemap https://www.devilstgirls.com/sitemap/main.xml
sitemap https://xmlsitemap.devilstgirls.com/devilstgirls_20211214.xml