celebrityinsider.org
robots.txt
Robots Exclusion Standard data for celebrityinsider.org
Resource Scan
Scan Details
| Site Domain | celebrityinsider.org |
| Base Domain | celebrityinsider.org |
| Scan Status | Ok |
| Last Scan | 2024-05-25T04:12:56+00:00 |
| Next Scan | 2024-06-01T04:12:56+00:00 |
Last Scan
| Scanned | 2024-05-25T04:12:56+00:00 |
| URL | https://celebrityinsider.org/robots.txt |
| Domain IPs | 104.26.4.106, 104.26.5.106, 172.67.68.63, 2606:4700:20::681a:46a, 2606:4700:20::681a:56a, 2606:4700:20::ac43:443f |
| Response IP | 104.26.4.106 |
| Found | Yes |
| Hash | 0cc633a308e224fefc80a827e1a3fb93429355fb530b42e99aba34690b3784f9 |
| SimHash | 2f1103540472 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /cgi-bin/ |
| Allow | /wp-admin/admin-ajax.php |
| Allow | /sitemap/?pg=* |
| Allow | /?p=* |
*
| Rule | Path |
|---|---|
| Disallow | /?* |
| Disallow | /*/?* |
| Disallow | /*/*/?* |
| Disallow | /*/*/*/?* |
| Disallow | /?s=* |
| Disallow | /*/?s=* |
| Disallow | /*/*/?s=* |
| Disallow | /home* |
| Disallow | /home/ |
| Disallow | /*?x= |
| Disallow | /*?action= |
| Disallow | /*%26action%3D |
| Disallow | /*?adid= |
| Disallow | /*%26adid%3D |
| Disallow | /*?bitrate= |
| Disallow | /*%26bitrate%3D |
| Disallow | /*?channel= |
| Disallow | /*%26channel%3D |
| Disallow | /*?clipid= |
| Disallow | /*%26clipid%3D |
| Disallow | /*?contentCollection= |
| Disallow | /*%26contentCollection%3D |
| Disallow | /*?contentId= |
| Disallow | /*%26contentId%3D |
| Disallow | /*?ei= |
| Disallow | /*%26ei%3D |
| Disallow | /*?format= |
| Disallow | /*%26format%3D |
| Disallow | /*?height= |
| Disallow | /*%26height%3D |
| Disallow | /*?iframe= |
| Disallow | /*%26iframe%3D |
| Disallow | /*?mediaId= |
| Disallow | /*%26mediaId%3D |
| Disallow | /*?module= |
| Disallow | /*%26module%3D |
| Disallow | /*?monthnum= |
| Disallow | /*%26monthnum%3D |
| Disallow | /*?pgtype= |
| Disallow | /*%26pgtype%3D |
| Disallow | /*?preview= |
| Disallow | /*%26preview%3D |
| Disallow | /*?priority= |
| Disallow | /*%26priority%3D |
| Disallow | /*?ref= |
| Disallow | /*%26ref%3D |
| Disallow | /*?referrer= |
| Disallow | /*%26referrer%3D |
| Disallow | /*?sa= |
| Disallow | /*%26sa%3D |
| Disallow | /*?section= |
| Disallow | /*%26section%3D |
| Disallow | /*?share= |
| Disallow | /*%26share%3D |
| Disallow | /*?TB_iframe= |
| Disallow | /*%26TB_iframe%3D |
| Disallow | /*?TBL_Prod100Page= |
| Disallow | /*%26TBL_Prod100Page%3D |
| Disallow | /*?theme_preview= |
| Disallow | /*%26theme_preview%3D |
| Disallow | /*?usg= |
| Disallow | /*%26usg%3D |
| Disallow | /*?ved= |
| Disallow | /*%26ved%3D |
| Disallow | /*?version= |
| Disallow | /*%26version%3D |
| Disallow | /*?VID= |
| Disallow | /*%26VID%3D |
| Disallow | /*?vxBitrate= |
| Disallow | /*%26vxBitrate%3D |
| Disallow | /*?vxChannel= |
| Disallow | /*%26vxChannel%3D |
| Disallow | /*?vxClipId= |
| Disallow | /*%26vxClipId%3D |
| Disallow | /*?vxSiteId= |
| Disallow | /*%26vxSiteId%3D |
| Disallow | /*?width= |
| Disallow | /*%26width%3D |
| Disallow | /*?year= |
| Disallow | /*%26year%3D |
| Disallow | /*.xml?uuid= |
| Disallow | /*?post_type=feedback&p= |
| Disallow | /*?wptouch_preview_theme= |
| Disallow | /*%26gt%3B |
| Disallow | /?attachment_id= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://celebrityinsider.org/sitemap-news.xml |
| sitemap | https://celebrityinsider.org/sitemap.xml |