gaynetwork.com
robots.txt

Robots Exclusion Standard data for gaynetwork.com

Resource Scan

Scan Details

Site Domain gaynetwork.com
Base Domain gaynetwork.com
Scan Status Ok
Last Scan2025-05-19T00:48:12+00:00
Next Scan 2025-06-18T00:48:12+00:00

Last Scan

Scanned2025-05-19T00:48:12+00:00
URL https://gaynetwork.com/robots.txt
Redirect https://www.gaynetwork.com/robots.txt
Redirect Domain www.gaynetwork.com
Redirect Base gaynetwork.com
Domain IPs 104.21.95.101, 172.67.144.71, 2606:4700:3032::6815:5f65, 2606:4700:3035::ac43:9047
Redirect IPs 104.21.95.101, 172.67.144.71, 2606:4700:3032::6815:5f65, 2606:4700:3035::ac43:9047
Response IP 104.21.95.101
Found Yes
Hash e185073981e5f1102dea69caa46ee39ed10b3fbd436f591ea6ede9d746b2e32b
SimHash 4969c38ac590

Groups

*

Rule Path
Allow /
Disallow *buy_download%3D*
Disallow *buy_stream%3D*
Disallow *logout%3D1*
Disallow *sessid%3D*
Disallow *redirect%3D*
Disallow *others%3D1*
Disallow *video_id%3D*
Disallow /*/videos/regarder/*
Disallow /*/videos/my-history
Disallow /*/videos/my-unseen
Disallow /*/videos/i-will-like
Disallow /*/dvd/my-history
Disallow /*/dvd/my-unseen
Disallow /*/dvd/i-will-like
Disallow /en/histoires*
Disallow /es/histoires*
Disallow /it/histoires*
Disallow /de/histoires*
Disallow /fr/histoires*

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gaynetwork.com/sitemap.xml