freebiefy.com
robots.txt
Robots Exclusion Standard data for freebiefy.com
Resource Scan
Scan Details
Site Domain | freebiefy.com |
Base Domain | freebiefy.com |
Scan Status | Ok |
Last Scan | 2024-11-13T20:56:26+00:00 |
Next Scan | 2024-11-20T20:56:26+00:00 |
Last Scan
Scanned | 2024-11-13T20:56:26+00:00 |
URL | https://freebiefy.com/robots.txt |
Redirect | https://freepsdflyer.com/robots.txt |
Redirect Domain | freepsdflyer.com |
Redirect Base | freepsdflyer.com |
Domain IPs | 104.21.64.50, 172.67.176.90, 2606:4700:3031::ac43:b05a, 2606:4700:3034::6815:4032 |
Redirect IPs | 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c |
Response IP | 104.16.150.108 |
Found | Yes |
Hash | ad8067a622ef57cf501526325a8045c0ae7ab2a07d5fa60db6e6e9b4313f95a8 |
SimHash | e924cac0d2f7 |
Groups
*
Rule | Path |
---|---|
Disallow | /dlm_uploads/ |
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /trackback/ |
Disallow | /feed/ |
Disallow | /comments/ |
Disallow | */trackback/ |
Disallow | */feed/ |
Disallow | */comments/ |
Disallow | /wp-admin/ |
Disallow | /wp-login.php |
Allow | /wp-admin/admin-ajax.php |
*
Rule | Path |
---|---|
Disallow | /downloads/ |
Disallow | /external-link/ |
Other Records
Field | Value |
---|---|
sitemap | https://freepsdflyer.com/sitemap_index.xml |
Comments