Log In Sign Up

bidayy.com
robots.txt

Robots Exclusion Standard data for bidayy.com

Resource Scan

Scan Details

Site Domain bidayy.com
Base Domain bidayy.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-15T18:20:24+00:00
Next Scan 2024-10-15T18:20:24+00:00

Last Successful Scan

Scanned2024-08-17T18:19:21+00:00
URL https://bidayy.com/robots.txt
Domain IPs 103.234.210.234, 2001:df7:3c00:ffff::80
Response IP 103.234.210.234
Found Yes
Hash cba85456c6f5e4b92ab03aac3fbb7813ebb363f31dcd165d2134afc97492c234
SimHash 5ea8da74949a

Groups

*

Rule Path
Disallow

mediapartners-google
nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Disallow /search

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow */komentar$
Disallow */komentar?*
Disallow */komentar/
Disallow /ajax/
Disallow /api/
Disallow /search/
Disallow /tag/foto/
Disallow *?tag_from
Disallow *?_ga
Disallow *%26sortby
Disallow *?device=desktop
Disallow *%26device%3Ddesktop
Allow /tag/news/

chatgpt-user

Rule Path
Disallow /

openai

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://bidayy.com/sitemap_index.xml
sitemap https://bidayy.com/post-sitemap.xml
sitemap https://bidayy.com/page-sitemap.xml
sitemap https://bidayy.com/category-sitemap.xml
sitemap https://bidayy.com/post_tag-sitemap.xml
sitemap https://bidayy.com/newstopic-sitemap.xml
sitemap https://bidayy.com/news-sitemap.xml
sitemap https://bidayy.com/google-news-sitemap.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ----------------------------
  • -------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top