*
| Rule |
Path |
| Disallow |
/wp/wp-admin/ |
| Allow |
/wp/wp-admin/admin-ajax.php |
*
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
bingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
semrushbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
semrushbot-sa
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
ahrefsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
yandexbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mj12bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
superfeedr bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
rssingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
zoombot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
surferbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
searchmetricsbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ias_crawler
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
velenpublicwebcrawler
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
everyonesocialbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
turnitinbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
blexbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
yak
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
mail.ru_bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
germcrawler
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
seznambot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
trendictionbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
paperlibot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
ccbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
10 |
Comments