comparic.pl
robots.txt

Robots Exclusion Standard data for comparic.pl

Archived Snapshots

Resource Scan

Scan Details

Site Domain	comparic.pl
Base Domain	comparic.pl
Scan Status	Ok
Last Scan	2024-06-14T22:17:33+00:00
Next Scan	2024-06-21T22:17:33+00:00

Last Scan

Scanned	2024-06-14T22:17:33+00:00
URL	https://comparic.pl/robots.txt
Domain IPs	137.74.203.230
Response IP	137.74.203.230
Found	Yes
Hash	7b9b8008b7c3c1d29a6fd9248b5f3c0dcf0207304560bf6453c1f2c4d31b5af9
SimHash	5010d942ac00

Groups

*

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php
Disallow	/*?comments
Disallow	/?s=
Disallow	/*?filter_by=
Disallow	/*?PageSpeed=noscript
Disallow	/*?fb_comment_id
Disallow	/*?fbclid

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

Disallow

/*?comments

Disallow

/?s=

Disallow

/*?filter_by=

Disallow

/*?PageSpeed=noscript

Disallow

/*?fb_comment_id

Disallow

/*?fbclid

msnbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	10

Field

Value

crawl-delay

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

siteauditbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-si

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-swa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-ct

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-bm

Rule	Path
Disallow	/

Rule

Path

Disallow

splitsignalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-coub

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

cohere-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili

Rule	Path
Disallow	/

Rule

Path

Disallow

omgilibot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

piplbot

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

awariorssbot

Rule	Path
Disallow	/

Rule

Path

Disallow

awariosmartbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

peer39_crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://comparic.pl/sitemap_index.xml
sitemap	https://comparic.pl/news-sitemap.xml
sitemap	https://comparic.pl/slownik-sitemap.xml
sitemap	https://comparic.pl/category-sitemap.xml

Field

Value

sitemap

https://comparic.pl/sitemap_index.xml

sitemap

https://comparic.pl/news-sitemap.xml

sitemap

https://comparic.pl/slownik-sitemap.xml

sitemap

https://comparic.pl/category-sitemap.xml

comparic.plrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

msnbot

Other Records

ahrefsbot

semrushbot

rogerbot

dotbot

semrushbot-sa

mj12bot

siteauditbot

semrushbot-si

semrushbot-swa

semrushbot-ct

semrushbot-bm

splitsignalbot

semrushbot-coub

chatgpt-user

gptbot

ccbot

facebookbot

anthropic-ai

cohere-ai

ia_archiver

omgili

omgilibot

mj12bot

piplbot

perplexitybot

claude-web

amazonbot

awariorssbot

awariosmartbot

bytespider

claudebot

dataforseobot

magpie-crawler

peer39_crawler

Other Records

comparic.pl
robots.txt