manyvids.com
robots.txt
Robots Exclusion Standard data for manyvids.com
Resource Scan
Scan Details
Site Domain | manyvids.com |
Base Domain | manyvids.com |
Scan Status | Ok |
Last Scan | 2024-05-08T12:52:18+00:00 |
Next Scan | 2024-06-07T12:52:18+00:00 |
Last Scan
Scanned | 2024-05-08T12:52:18+00:00 |
URL | https://manyvids.com/robots.txt |
Redirect | https://www.manyvids.com/robots.txt |
Redirect Domain | www.manyvids.com |
Redirect Base | manyvids.com |
Domain IPs | 13.33.30.125, 13.33.30.76, 13.33.30.8, 13.33.30.83, 2600:9000:229f:1600:5:d53a:fc40:93a1, 2600:9000:229f:5200:5:d53a:fc40:93a1, 2600:9000:229f:7600:5:d53a:fc40:93a1, 2600:9000:229f:7c00:5:d53a:fc40:93a1, 2600:9000:229f:b800:5:d53a:fc40:93a1, 2600:9000:229f:c00:5:d53a:fc40:93a1, 2600:9000:229f:d600:5:d53a:fc40:93a1, 2600:9000:229f:d800:5:d53a:fc40:93a1 |
Redirect IPs | 13.33.88.106, 13.33.88.17, 13.33.88.27, 13.33.88.74 |
Response IP | 13.33.88.74 |
Found | Yes |
Hash | 8ae2325f585b7a8cf381a4d1fba22941b63d03d7ccec7af8e522fb65316fb8a1 |
SimHash | 69159dc4c1e0 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /bower_components |
Disallow | /ffmpeg |
Disallow | /GeoIp2 |
Disallow | /includes |
Disallow | /php-jwt-master |
Disallow | /php_uploads |
Disallow | /tmhOAuth-master |
Disallow | /tmp |
Disallow | /tumblr_oauth |
Disallow | /twitteroauth-master |
Disallow | /widget |
Disallow | /grunt |
Disallow | /Social/ajax |
Other Records
Field | Value |
---|---|
sitemap | https://www.manyvids.com/sitemap/sitemap.xml |