hardx.com
robots.txt

Robots Exclusion Standard data for hardx.com

Resource Scan

Scan Details

Site Domain hardx.com
Base Domain hardx.com
Scan Status Ok
Last Scan2025-10-07T04:33:40+00:00
Next Scan 2025-11-06T04:33:40+00:00

Last Scan

Scanned2025-10-07T04:33:40+00:00
URL https://hardx.com/robots.txt
Redirect https://www.hardx.com/robots.txt
Redirect Domain www.hardx.com
Redirect Base hardx.com
Domain IPs 104.26.6.90, 104.26.7.90, 172.67.73.160
Redirect IPs 104.26.6.90, 104.26.7.90, 172.67.73.160
Response IP 172.67.73.160
Found Yes
Hash d824819910df6810eddf620a3d0138efc8dbfb38b8a285a592a6a1a566b64175
SimHash 750d11ca4db4

Groups

*

Rule Path
Disallow /ratings/actor*
Disallow /media/signPhotoset*
Disallow /comment/actor*

Other Records

Field Value
sitemap https://www.hardx.com/sitemap/main.xml
sitemap https://www.hardx.com/sitemap/actor.xml
sitemap https://www.hardx.com/sitemap/scene-1.xml
sitemap https://www.hardx.com/sitemap/scene-2.xml
sitemap https://www.hardx.com/sitemap/scene-3.xml
sitemap https://www.hardx.com/sitemap/scene-4.xml
sitemap https://www.hardx.com/sitemap/photoset.xml
sitemap https://www.hardx.com/sitemap/dvd-1.xml
sitemap https://www.hardx.com/sitemap/dvd-2.xml
sitemap https://www.hardx.com/sitemap/dvd-3.xml
sitemap https://xmlsitemap.hardx.com/hardx_20220427.xml