bigaytube.com
robots.txt
Robots Exclusion Standard data for bigaytube.com
Resource Scan
Scan Details
Site Domain | bigaytube.com |
Base Domain | bigaytube.com |
Scan Status | Ok |
Last Scan | 2025-03-15T15:12:13+00:00 |
Next Scan | 2025-04-14T15:12:13+00:00 |
Last Scan
Scanned | 2025-03-15T15:12:13+00:00 |
URL | https://bigaytube.com/robots.txt |
Domain IPs | 104.21.23.105, 172.67.210.127, 2606:4700:3031::ac43:d27f, 2606:4700:3035::6815:1769 |
Response IP | 104.21.23.105 |
Found | Yes |
Hash | 366d12f2f2c0f98536e2f352e81f3a2ab5181e150fb778fe6a284c086251ca16 |
SimHash | 65014750d912 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/ |
Disallow | /cgi-bin/ |
Disallow | /img/ |
Disallow | /css/ |
Disallow | /menu/ |
Disallow | /news?id=* |
Disallow | /color/ |
Disallow | /text-image/ |
Allow | *.js |
Allow | *.css |