free4dump.com
robots.txt
Robots Exclusion Standard data for free4dump.com
Resource Scan
Scan Details
Site Domain | free4dump.com |
Base Domain | free4dump.com |
Scan Status | Ok |
Last Scan | 5/27/2025, 2:53:19 PM |
Next Scan | 6/3/2025, 2:53:19 PM |
Last Scan
Scanned | 5/27/2025, 2:53:19 PM |
URL | https://free4dump.com/robots.txt |
Redirect | http://www.free4dump.com/robots.txt |
Redirect Domain | www.free4dump.com |
Redirect Base | free4dump.com |
Domain IPs | 104.21.33.88, 172.67.160.182, 2606:4700:3033::ac43:a0b6, 2606:4700:3036::6815:2158 |
Redirect IPs | 104.21.33.88, 172.67.160.182, 2606:4700:3033::ac43:a0b6, 2606:4700:3036::6815:2158 |
Response IP | 104.21.33.88 |
Found | Yes |
Hash | 614b010cbd41f7faf92c9a3fbea927b31262bbcdbceca5aac1c780dd8b92c2e2 |
SimHash | f29edc53c89a |
Groups
*
Rule | Path |
---|---|
Disallow | /act.php |
Disallow | /search.php |
Disallow | /reg.php |
Disallow | /*.ashx |
Disallow | /*.aspx |
Disallow | /TestEngine/ |
Disallow | /demo/ |
Disallow | /pay* |
Disallow | /page_* |
Disallow | /livechat.php |
Disallow | /cart.php |
Disallow | /checkout.php |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | http://www.free4dump.com/sitemap.xml |
Warnings
- 2 invalid lines.