br.xhsoftware.site
robots.txt

Robots Exclusion Standard data for br.xhsoftware.site

Resource Scan

Scan Details

Site Domain br.xhsoftware.site
Base Domain xhsoftware.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-20T13:33:54+00:00
Next Scan 2025-12-04T13:33:54+00:00

Last Successful Scan

Scanned2025-10-12T01:29:00+00:00
URL https://br.xhsoftware.site/robots.txt
Domain IPs 2a02:b48:4000:d:c7:12:2211:113, 2a02:b49:4:8:c7:12:2211:113, 45.144.150.12
Response IP 45.144.150.12
Found Yes
Hash ee952e72999bcf0b8c1f5f60bc9f925ba88b1e350c02816d5dfd159015ca2e70
SimHash 2f02eb23e49a

Groups

*

Rule Path
Disallow *light%3D*
Disallow /movies/*/download/
Disallow /premium/
Allow /users/
Disallow /users/*/friends
Disallow /users/*/favorites
Disallow /users/profiles/
Disallow /posts/
Disallow /embed/
Allow /users/creators
Allow /user/xHamster/blog/*
Allow /user/xHamster/posts/*
Disallow /stories/*/print
Disallow *embedded_video*
Disallow /photos/gallery/*/
Allow /photos/gallery/*/2$
Allow /photos/gallery/*/3$
Allow /photos/gallery/*/4$
Allow /photos/gallery/*/5$
Allow /photos/gallery/*.html
Disallow /ab.log
Disallow /hot-7
Disallow /hot-30
Disallow /hot-7-pro
Disallow /hot-30-pro
Disallow /switch
Disallow *?max-duration=
Disallow *?min-duration=
Disallow *%26max-duration%3D
Disallow *%26min-duration%3D
Disallow *?geo=
Disallow */categories/*/best/daily
Disallow */categories/*/best/monthly
Disallow */categories/*/best/weekly
Disallow */categories/*/best/year-20
Disallow */categories/*/most-commented
Disallow */categories/*/most-viewed
Disallow */categories/*/producer
Disallow */categories/*/creator
Disallow */channels/*/newest
Disallow */channels/*/best
Disallow */channels/*/most-commented
Disallow */channels/*/most-viewed
Disallow */pornstars/*/newest
Disallow */pornstars/*/best
Disallow */pornstars/*/most-commented
Disallow */pornstars/*/most-viewed
Disallow */pornstars/*/exclusive
Disallow */creators/*/newest
Disallow */creators/*/best
Disallow */creators/*/most-commented
Disallow */creators/*/most-viewed
Disallow */creators/*/exclusive
Disallow */creators/*/full-length
Disallow */celebrities/*/newest
Disallow */celebrities/*/best
Disallow */celebrities/*/most-commented
Disallow */celebrities/*/most-viewed
Disallow */tags/*/newest
Disallow */tags/*/best
Disallow */tags/*/most-commented
Disallow */tags/*/most-viewed
Disallow */tags/*/producer
Disallow */tags/*/creator
Allow */categories/*/best
Allow */pornstars/all/*/best
Allow */creators/all/*/best
Allow */celebrities/all/*/best
Disallow */categories/*/best*?max-duration=
Disallow */categories/*/best*?min-duration=
Disallow */categories/*/best*%26max-duration%3D
Disallow */categories/*/best*%26min-duration%3D
Disallow /exit.php
Disallow */*/*/vr?*dimension=
Disallow */*/*/vr?*angle=
Disallow */categories/*fps%3D
Disallow */tags/*fps%3D
Disallow */channels/*fps%3D
Disallow */pornstars/*fps%3D
Disallow */creators/*fps%3D
Disallow */celebrities/*fps%3D
Disallow *%3Dproducer
Disallow *%3Dcreator
Disallow /signup?
Disallow /api/
Disallow */search/*cats%3D
Disallow */search/*correction%3D
Disallow */search/*date%3D
Disallow */search/*length%3D
Disallow */search/*orientations%3D
Disallow */search/*prod%3D
Disallow */search/*revert%3D
Disallow */search/*hidewatched%3D
Disallow */search/*sort%3Ddate
Disallow */search/*sort%3Dlongest
Disallow */search/*sort%3Dviews
Disallow */search/*angle%3D
Disallow */search/*dimension%3D
Disallow */search/*page%3D
Allow */search/*?page=2$
Allow */search/*?page=3$
Allow */search/*?page=4$
Allow */search/*?page=5$
Allow */search/*?page=6$
Allow */search/*?page=7$
Allow */search/*?page=8$
Allow */search/*?page=9$
Allow */search/*?page=10$
Allow */search/*?sort=best&page=2$
Allow */search/*?sort=best&page=3$
Allow */search/*?sort=best&page=4$
Allow */search/*?sort=best&page=5$
Allow */search/*?sort=best&page=6$
Allow */search/*?sort=best&page=7$
Allow */search/*?sort=best&page=8$
Allow */search/*?sort=best&page=9$
Allow */search/*?sort=best&page=10$
Disallow *?skip=
Disallow *%26skip%3D
Disallow /webcams/
Disallow /tracking?
Disallow *?x_platform_switch=*
Disallow /xembed.php
Disallow /livevideoamp/
Disallow /fhwidgetamp/
Disallow /info/list-of-processors
Disallow /info/dsa-transparency-report-2024

ia_archiver

Rule Path
Disallow /

Comments

  • Disallow all pagination
  • Allow search pages from 2 to 10
  • Allow best search pages from 2 to 10