just-wiped.net
robots.txt

Robots Exclusion Standard data for just-wiped.net

Resource Scan

Scan Details

Site Domain just-wiped.net
Base Domain just-wiped.net
Scan Status Ok
Last Scan2024-09-21T00:45:24+00:00
Next Scan 2024-09-28T00:45:24+00:00

Last Scan

Scanned2024-09-21T00:45:24+00:00
URL https://just-wiped.net/robots.txt
Domain IPs 95.216.23.42
Response IP 95.216.23.42
Found Yes
Hash 31918e46daa10f4efadf1b35867ddf655870512d6b586e0dded96428abaafcf4
SimHash a9932f847bc6

Groups

*

Rule Path
Disallow /rust_servers/*/web_badges
Disallow /rust_servers/*/web_badges/
Disallow /rust_servers/*/web_badges/*
Disallow /stream_notifications/*
Disallow /stream_notifications/*/go_to
Disallow /stream_notifications/*/disable
Disallow /rust-maps/*/download
Disallow /terms-and-conditions
Disallow /privacy-policy
Disallow /legals
Disallow /user/*

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file