4ip.info
robots.txt

Robots Exclusion Standard data for 4ip.info

Resource Scan

Scan Details

Site Domain 4ip.info
Base Domain 4ip.info
Scan Status Ok
Last Scan2025-11-06T14:51:36+00:00
Next Scan 2025-12-06T14:51:36+00:00

Last Scan

Scanned2025-11-06T14:51:36+00:00
URL https://4ip.info/robots.txt
Domain IPs 149.154.65.245
Response IP 149.154.65.245
Found Yes
Hash 3a956736e0fa0061321e4518018416a2bb8417da9508b63615de02226c439bbe
SimHash 6b1c08d7ef85

Groups

yandex

Rule Path
Allow /*?page=
Allow /*?kind_id=
Disallow /*?*
Disallow /*.php
Disallow /*.html
Disallow /ajax/
Disallow /captcha/
Disallow /cdek-widget/
Disallow /feeds/
Disallow /payment/
Disallow /resize/
Disallow /simpla/
Disallow /search*
Disallow /cart
Disallow /order/
Disallow /neworder/
Disallow /track
Disallow /user

googlebot

Rule Path
Allow /*?page=
Allow /*?kind_id=
Allow /*?store_id=
Disallow /*?*
Disallow /*.php
Disallow /*.html
Disallow /ajax/
Disallow /captcha/
Disallow /cdek-widget/
Disallow /feeds/
Disallow /payment/
Disallow /resize/
Disallow /simpla/
Disallow /search*
Disallow /cart
Disallow /order/
Disallow /neworder/
Disallow /track
Disallow /user

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

websnake

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

web-by-mail

Rule Path
Disallow /

psbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

*

Rule Path
Allow /*?page=
Allow /*?kind_id=
Disallow /*?*
Disallow /*.php
Disallow /*.html
Disallow /ajax/
Disallow /captcha/
Disallow /cdek-widget/
Disallow /feeds/
Disallow /payment/
Disallow /resize/
Disallow /simpla/
Disallow /search*
Disallow /cart
Disallow /order/
Disallow /neworder/
Disallow /track
Disallow /user

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://4ip.info/sitemap.xml

Warnings

  • `clean-param` is not a known field.