bygosh.com
robots.txt
Robots Exclusion Standard data for bygosh.com
Resource Scan
Scan Details
| Site Domain | bygosh.com |
| Base Domain | bygosh.com |
| Scan Status | Ok |
| Last Scan | 2024-10-01T21:46:07+00:00 |
| Next Scan | 2024-10-08T21:46:07+00:00 |
Last Scan
| Scanned | 2024-10-01T21:46:07+00:00 |
| URL | https://bygosh.com/robots.txt |
| Domain IPs | 104.21.54.216, 172.67.142.216, 2606:4700:3033::ac43:8ed8, 2606:4700:3034::6815:36d8 |
| Response IP | 172.67.142.216 |
| Found | Yes |
| Hash | a1c8a0dbfb6808428b06d56e9159b6f416151653ef72aa13fad95a30cc23f67d |
| SimHash | e24412526efd |
Groups
admantx
ahrefsbot
alexa
amazonadbot
blexbot
bbot
brands-bot
bytespider
ccbot
clickagy
cliqzbot
contxbot
datagnionbot
dotbot
dotmic
gluten free crawler
grapeshot
grapeshot
grapeshotcrawler
ias crawler
komodiabot
mail.ru_bot
megaindex.ru
mojeekbot
mj12bot
nimbostratus
nutch
obot
outclicksbot
photon
phantomjs
proximic
qwantify
screaming frog seo spider
semanticscholarbot
semrushbot
seokicks
startmebot
tineye-bot
xovibot
zoominfobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /search |
| Disallow | /?s= |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bygosh.com/sitemap_index.xml |
Warnings
- 1 invalid line.