24livenewspaper.com
robots.txt
Robots Exclusion Standard data for 24livenewspaper.com
Resource Scan
Scan Details
Site Domain | 24livenewspaper.com |
Base Domain | 24livenewspaper.com |
Scan Status | Ok |
Last Scan | 2024-05-27T17:02:38+00:00 |
Next Scan | 2024-06-03T17:02:38+00:00 |
Last Scan
Scanned | 2024-05-27T17:02:38+00:00 |
URL | https://24livenewspaper.com/robots.txt |
Redirect | https://www.24livenewspaper.com/robots.txt |
Redirect Domain | www.24livenewspaper.com |
Redirect Base | 24livenewspaper.com |
Domain IPs | 104.26.14.65, 104.26.15.65, 172.67.70.234, 2606:4700:20::681a:e41, 2606:4700:20::681a:f41, 2606:4700:20::ac43:46ea |
Redirect IPs | 104.26.14.65, 104.26.15.65, 172.67.70.234, 2606:4700:20::681a:e41, 2606:4700:20::681a:f41, 2606:4700:20::ac43:46ea |
Response IP | 104.26.14.65 |
Found | Yes |
Hash | 2070570bd3f70bb757c097d632091839ecec7e88aca61802d20689a539c2a30e |
SimHash | 5d3cc36541dc |
Groups
*
Rule | Path |
---|---|
Allow | /*.js* |
Allow | /*.css* |
Allow | /*.png* |
Allow | /*.jpg* |
Allow | /*.jpeg* |
Allow | /*.gif* |
Disallow | /administrator/ |
Disallow | /bin/ |
Disallow | /cache/ |
Disallow | /cli/ |
Disallow | /includes/ |
Disallow | /installation/ |
Disallow | /language/ |
Disallow | /layouts/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /tmp/ |
Disallow | /cri/ |
Disallow | /gndr/ |
Disallow | /bangla/gndr/ |
Disallow | /testmm/ |
Disallow | /dbangla/ |
Disallow | /ddbangla/ |
Disallow | /cont/ |
Disallow | /file/ |
Disallow | /file24/ |
Disallow | /rss/ |
Disallow | /fifa-world-cup-2014/ |
Disallow | /siteh/ |
Disallow | /sitetest/ |
Disallow | /sitez/ |
Disallow | /sitew/ |
Disallow | /sitesp/ |
Disallow | /sittest/ |
Disallow | /test/ |
Disallow | /test1/ |
Disallow | /test2/ |
Disallow | /bn/ |
Disallow | /sites/ |
Disallow | /site/ |
Disallow | /sinfo/ |
Disallow | /third/ |