princeitsolution.com
robots.txt

Robots Exclusion Standard data for princeitsolution.com

Resource Scan

Scan Details

Site Domain princeitsolution.com
Base Domain princeitsolution.com
Scan Status Ok
Last Scan2025-12-10T18:43:27+00:00
Next Scan 2025-12-17T18:43:27+00:00

Last Scan

Scanned2025-12-10T18:43:27+00:00
URL https://princeitsolution.com/robots.txt
Redirect https://www.princeitsolution.com/robots.txt
Redirect Domain www.princeitsolution.com
Redirect Base princeitsolution.com
Domain IPs 2a02:4780:84:4077:2c03:aa8f:f92d:a0c3, 2a02:4780:84:ea65:d16f:1bd3:5496:5fe3, 84.32.84.133, 84.32.84.97
Redirect IPs 2a02:4780:84:5a27:51bd:e796:4278:212a, 2a02:4780:84:7bb4:f4dd:4340:e2b:6f9a, 84.32.84.121, 84.32.84.170
Response IP 77.37.48.194
Found Yes
Hash bfea630d74726a7fdecf861a9af6e7a1416f9e9c34d3cdd3f42bc369b507d473
SimHash 2d901b926024

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /storage/
Disallow /vendor/
Disallow /bootstrap/
Disallow /config/
Disallow /database/
Disallow /resources/
Disallow /routes/
Disallow /tests/
Disallow /app/
Disallow /composer.json
Disallow /composer.lock
Disallow /package.json
Disallow /package-lock.json
Disallow /artisan
Disallow /phpunit.xml
Disallow /.env
Disallow /.git/
Disallow /.gitignore
Disallow /.gitattributes
Disallow /.editorconfig
Allow /sitemap.xml
Allow /robots.txt
Allow /favicon.ico
Allow /assets/
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /
Disallow /admin/

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Allow /
Disallow /admin/

googlebot-mobile

Rule Path
Allow /
Disallow /admin/

bingbot

Rule Path
Allow /
Disallow /admin/

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Allow /
Disallow /admin/

Other Records

Field Value
crawl-delay 2

baiduspider

Rule Path
Allow /
Disallow /admin/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://princeitsolution.com/sitemap.xml

Comments

  • Global rules for all crawlers
  • Allow important assets and pages
  • Sitemap for Google and other crawlers
  • Crawl delay (optional)
  • ---- Specific Search Engine Rules ----
  • Googlebot (explicit permission)
  • Google Image Bot
  • Google Mobile Bot
  • Bingbot
  • Yandex
  • Baidu