goinbigdata.com
robots.txt
Robots Exclusion Standard data for goinbigdata.com
Resource Scan
Scan Details
| Site Domain | goinbigdata.com |
| Base Domain | goinbigdata.com |
| Scan Status | Ok |
| Last Scan | 2024-05-27T13:18:12+00:00 |
| Next Scan | 2024-06-26T13:18:12+00:00 |
Last Scan
| Scanned | 2024-05-27T13:18:12+00:00 |
| URL | https://goinbigdata.com/robots.txt |
| Redirect | https://codewithyury.com/robots.txt |
| Redirect Domain | codewithyury.com |
| Redirect Base | codewithyury.com |
| Domain IPs | 104.21.10.198, 172.67.131.182, 2606:4700:3030::ac43:83b6, 2606:4700:3031::6815:ac6 |
| Redirect IPs | 104.21.75.162, 172.67.178.188, 2606:4700:3030::ac43:b2bc, 2606:4700:3034::6815:4ba2 |
| Response IP | 172.67.178.188 |
| Found | Yes |
| Hash | a09a6a13d04a5ef13b67179096bf851b77d074adc5c8f26b4b48c5926c25a0cd |
| SimHash | 30045740e997 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /css/ |
| Disallow | /images/ |
| Disallow | /js/ |
| Disallow | /categories/ |
| Disallow | /tags/ |
| Disallow | /index.html |
| Disallow | /index.xml |
| Disallow | /page/ |
| Disallow | /post/ |