fossbytes.com
robots.txt
Robots Exclusion Standard data for fossbytes.com
Resource Scan
Scan Details
| Site Domain | fossbytes.com |
| Base Domain | fossbytes.com |
| Scan Status | Ok |
| Last Scan | 2024-09-26T13:02:09+00:00 |
| Next Scan | 2024-10-03T13:02:09+00:00 |
Last Scan
| Scanned | 2024-09-26T13:02:09+00:00 |
| URL | https://fossbytes.com/robots.txt |
| Domain IPs | 104.21.89.140, 172.67.160.54, 2606:4700:3036::ac43:a036, 2606:4700:3037::6815:598c |
| Response IP | 104.21.89.140 |
| Found | Yes |
| Hash | e287bdd08fb9a1d49efe7618f6ca99b21e7660eb9e8712f92afb9aafd6cc3ac6 |
| SimHash | 347f4cb726d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */wp-admin |
| Disallow | */wp-includes |
| Disallow | */wp-trackback/ |
| Disallow | */wp-feed/ |
| Disallow | */wp-comments/ |
| Disallow | */wp-content/themes |
| Disallow | */wp-login.php |
| Disallow | */wp-register.php |
| Disallow | /search/ |
| Disallow | /*?*s= |
| Disallow | /*?*_gl= |
| Disallow | /*?*utm_ |
| Disallow | /*?*nonamp=1%2F |
| Disallow | /*?*fbclid= |
| Disallow | /*?*fb_comment_id= |
| Disallow | /*?*fromNewsdog= |
| Disallow | /*?*msclkid= |
| Disallow | /*?*amp=1%2F |
| Disallow | /*?*ref=coinnounce.com |
| Disallow | /*?*mid=1 |
| Disallow | /*?*nowprocket=1%2F&nonamp=1%2F |
| Disallow | /*?*feed_id=8998&_unique_id=5e589a59cecbf |
| Disallow | /*?*usq%2F |
| Disallow | /*?*id=1%271000%2F |
| Disallow | /*?*rand=1168%2F |
| Disallow | /*?*id=1%271000%2F |
| Disallow | /*?*Uid= |
| Disallow | /*?*darkschemeovr=1%2F |
| Disallow | /*?*__cf_chl_captcha_tk__= |
| Disallow | /*?*arena_mid= |
| Disallow | /*?*fb_comment_id= |
| Disallow | /*?*filter_by= |
| Disallow | /*?*back= |
| Disallow | /*?*amp_js_v= |
| Disallow | /*?*v= |
| Disallow | /*?*wordfence |
| Disallow | /*?*platform= |
| Disallow | /*?*time= |
| Disallow | /*?*referrer= |
| Disallow | /*?*%21&ptn= |
| Disallow | /*?*nowprocket= |
| Disallow | /*?*__twitter_impression= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fossbytes.com/sitemap_index.xml |