kiasuparent.com
robots.txt

Robots Exclusion Standard data for kiasuparent.com

Resource Scan

Scan Details

Site Domain kiasuparent.com
Base Domain kiasuparent.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-02-19T23:46:58+00:00
Next Scan 2025-05-20T23:46:58+00:00

Last Successful Scan

Scanned2024-04-26T23:27:32+00:00
URL http://kiasuparent.com/robots.txt
Redirect https://www.kiasuparents.com/robots.txt
Redirect Domain www.kiasuparents.com
Redirect Base kiasuparents.com
Domain IPs 103.15.232.239
Redirect IPs 104.26.6.132, 104.26.7.132, 172.67.71.198, 2606:4700:20::681a:684, 2606:4700:20::681a:784, 2606:4700:20::ac43:47c6
Response IP 172.67.71.198
Found Yes
Hash 9bedd8b2a7d13763803622b55417c1de8f3bee123eb33995d3aecc41372b3661
SimHash 218e48196ea7

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6

*

Rule Path
Disallow /kiasu/wp-admin
Disallow /kiasu/wp-login.php?action=logout
Disallow /kiasu/author
Disallow /kiasu/forum/privmsg.php
Disallow /kiasu/forum/profile.php
Disallow /kiasu/forum/mcp.php
Disallow /kiasu/forum/ucp.php
Disallow /kiasu/forum/login.php
Disallow /kiasu/forum/search.php
Disallow /kiasu/forum/cache
Disallow /1073400/

Other Records

Field Value
sitemap https://www.kiasuparents.com/kiasu/sitemap_index.xml

Comments

  • /robots.txt file for http://www.kiasuparents.com/
  • Sitemap: http://www.kiasuparents.com/kiasu/forum/sitemap.xml
  • Sitemap: https://www.kiasuparents.com/kspforum_sitemap.php
  • Sitemap: http://www.kiasuparents.com/ksp_sitemap.php
  • User-agent: Googlebot
  • Disallow: /kiasu/forum/viewforum.php?f=34
  • Disallow: /kiasu/forum/viewforum.php?f=21
  • Disallow: /kiasu/forum/viewforum.php?f=31
  • Disallow: /kiasu/forum/viewforum.php?f=84
  • Disallow: /kiasu/forum/images