Log In Sign Up

apyrn.com
robots.txt

Robots Exclusion Standard data for apyrn.com

Resource Scan

Scan Details

Site Domain apyrn.com
Base Domain apyrn.com
Scan Status Ok
Last Scan2025-10-31T22:05:38+00:00
Next Scan 2025-11-14T22:05:38+00:00

Last Scan

Scanned2025-10-31T22:05:38+00:00
URL https://apyrn.com/robots.txt
Domain IPs 63.250.38.8
Response IP 63.250.38.8
Found Yes
Hash eb08a4e7bb173c61427c9ed36daaea024193057bcf08f0f91fa788cbac5adee4
SimHash 6f715a7264b2

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/
Disallow /_next/
Disallow /404
Disallow /500
Disallow /build/
Disallow /node_modules/
Disallow /.env
Disallow /package.json
Disallow /package-lock.json
Allow /static/css/
Allow /static/js/
Allow /static/media/
Allow /*.css$
Allow /*.js$
Allow /*.png$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /*.svg$
Allow /*.webp$
Allow /*.ico$
Allow /tools/
Allow /products/
Allow /services/
Allow /contact
Allow /about
Allow /blog/
Allow /ai-sitemap.xml
Allow /ai-discovery.html
Allow /structured-data.json

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://apyrn.com/sitemap-index.xml
sitemap https://apyrn.com/sitemap.xml
sitemap https://apyrn.com/sitemap-tools.xml
sitemap https://apyrn.com/sitemap-products.xml
sitemap https://apyrn.com/sitemap-services.xml
Back to top

Comments

  • Robots.txt for Apyrn.com
  • Last updated: 2024-12-09
  • Allow all search engines to crawl the site
  • Disallow specific directories and files
  • Allow important static files
  • Allow important pages and directories
  • AI Discovery Resources
  • Specific rules for Google
  • Specific rules for Bing
  • Block bad bots
  • Sitemaps - All sitemaps for better indexing
  • Host directive
Back to top

Warnings

  • `host` is not a known field.
Back to top