pichunt.tech
robots.txt

Robots Exclusion Standard data for pichunt.tech

Resource Scan

Scan Details

Site Domain pichunt.tech
Base Domain pichunt.tech
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-07-15T00:54:14+00:00
Next Scan 2025-10-13T00:54:14+00:00

Last Successful Scan

Scanned2024-12-17T12:47:02+00:00
URL https://pichunt.tech/robots.txt
Redirect https://sooperb.io/robots.txt
Redirect Domain sooperb.io
Redirect Base sooperb.io
Domain IPs 13.234.171.182
Redirect IPs 13.234.171.182
Response IP 13.234.171.182
Found Yes
Hash ce2df4756de85d595c8f10b7a782a16c0fcd0326ca3fecaca0becca27c43f319
SimHash 110048a4a1fb

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

bingbot

Rule Path
Allow /
Allow /sitemap/
Allow /h264-video-previews/
Disallow /admin/
Disallow /home-7.html
Disallow /home-3.html
Disallow /slider-3d.html
Disallow /sign-up.html
Disallow /index.php
Disallow /blog-grid.html
Disallow /listing.html
Disallow /blog-grid-1.html
Disallow /home-5.html
Disallow /ranking.html
Disallow /login.html
Disallow /blog-detail.html
Disallow /nft-detail-2.html

uptimerobot

Rule Path
Allow /

badbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

facebookexternalhit, facebookbot

Rule Path
Disallow /nocrawl

facebot

Rule Path
Disallow /

openai-gpt, gptbot

Rule Path
Disallow /

meta-externalagent/1.1

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

Comments

  • Allow UptimeRobot for uptime monitoring
  • Disallow known bad bots and scrapers
  • Block social media and AI-based crawlers