naidunia.com
robots.txt
Robots Exclusion Standard data for naidunia.com
Resource Scan
Scan Details
| Site Domain | naidunia.com |
| Base Domain | naidunia.com |
| Scan Status | Ok |
| Last Scan | 2024-11-08T16:59:53+00:00 |
| Next Scan | 2024-11-15T16:59:53+00:00 |
Last Scan
| Scanned | 2024-11-08T16:59:53+00:00 |
| URL | https://naidunia.com/robots.txt |
| Redirect | https://www.naidunia.com/robots.txt |
| Redirect Domain | www.naidunia.com |
| Redirect Base | naidunia.com |
| Domain IPs | 34.93.52.48 |
| Redirect IPs | 23.210.105.121, 2600:1413:1:982::18c7 |
| Response IP | 23.210.105.121 |
| Found | Yes |
| Hash | 14d5907be432617355faeef2024ebff8ccf4716653e681807897ee89c26af779 |
| SimHash | 2a3cf751c811 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*.aspx* |
| Disallow | /*.asp* |
| Disallow | /*php?id* |
| Disallow | /*13276288* |
| Disallow | /home |
| Disallow | */search/* |
| Disallow | *?itm* |
| Disallow | *-page1* |
| Disallow | *-page2* |
| Disallow | *-page3* |
| Disallow | *-page4* |
| Disallow | *-page5* |
| Disallow | *-page6* |
| Disallow | *-page7* |
| Disallow | *-page8* |
| Disallow | *-page9* |
| Disallow | */photo-gallery/* |
| Disallow | */topics-trending/* |
| Disallow | */trending/* |
| Disallow | /pfp |
| Disallow | /pfp/ |
| Disallow | /pfp/* |
| Disallow | *?utm_source* |
| Disallow | *?utm_medium* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.naidunia.com/news-sitemap-nd.xml |
| sitemap | https://www.naidunia.com/nd-webstories-sitemap.xml |
| sitemap | https://www.naidunia.com/web-sitemap-nd.xml |
Comments