whosopen.net
robots.txt
Robots Exclusion Standard data for whosopen.net
Resource Scan
Scan Details
Site Domain | whosopen.net |
Base Domain | whosopen.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-09-07T22:22:09+00:00 |
Next Scan | 2025-12-06T22:22:09+00:00 |
Last Successful Scan
Scanned | 2024-02-16T11:54:29+00:00 |
URL | https://whosopen.net/robots.txt |
Domain IPs | 104.21.3.243, 172.67.131.92, 2606:4700:3030::6815:3f3, 2606:4700:3033::ac43:835c |
Response IP | 172.67.131.92 |
Found | Yes |
Hash | d87d34a6c7fe4c14215f6d8bf9c6955fbfaefbbc5dbb1c4d1e63f515655be371 |
SimHash | c932c0c8f36a |
Groups
*
Rule | Path |
---|---|
Allow | /en/public-url* |
Allow | /sitemap/* |
Allow | /en/listing* |
Allow | /en/local-south-african-* |
Allow | /en/popular-local-* |
Allow | /en/local-company* |
Allow | /en/local-business* |
Allow | /sitemap/* |
Disallow | /includes* |
Disallow | /data* |
Disallow | /images* |
Disallow | /modules* |
Disallow | *function.include* |
Disallow | *function.require* |
Disallow | *flights/cheap-flights-from-imagesgallery* |
Disallow | *flights/cheap-flights-from-3rdcategory_php* |
Disallow | *city-city_php* |
Disallow | *city_city_php* |
Disallow | /images/gallery* |
Disallow | *imagesgalleryimages* |