dirfile.com
robots.txt

Robots Exclusion Standard data for dirfile.com

Resource Scan

Scan Details

Site Domain dirfile.com
Base Domain dirfile.com
Scan Status Ok
Last Scan2024-09-02T00:59:22+00:00
Next Scan 2024-10-02T00:59:22+00:00

Last Scan

Scanned2024-09-02T00:59:22+00:00
URL https://dirfile.com/robots.txt
Redirect http://www.dirfile.com/robots.txt
Redirect Domain www.dirfile.com
Redirect Base dirfile.com
Domain IPs 104.21.87.81, 172.67.142.130, 2606:4700:3034::6815:5751, 2606:4700:3034::ac43:8e82
Redirect IPs 104.21.87.81, 172.67.142.130, 2606:4700:3034::6815:5751, 2606:4700:3034::ac43:8e82
Response IP 172.67.142.130
Found Yes
Hash 756ce2477fbdc60813133039568a88e31d838900c2a7efc01ec9948f86d14b75
SimHash 9807d340cad7

Groups

*

Rule Path
Disallow /go.php
Disallow /siteredirect.php
Disallow /downcount.php
Disallow /viewcount.php
Disallow /downloadstart.php
Disallow /downloadupdate.php

webcopier

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

zeus

Rule Path
Disallow /

teleport

Rule Path
Disallow /

harvest

Rule Path
Disallow /

netcraft

Rule Path
Disallow /