Log In Sign Up

skcript.com
robots.txt

Robots Exclusion Standard data for skcript.com

Resource Scan

Scan Details

Site Domain skcript.com
Base Domain skcript.com
Scan Status Ok
Last Scan2024-09-25T15:03:46+00:00
Next Scan 2024-10-02T15:03:46+00:00

Last Scan

Scanned2024-09-25T15:03:46+00:00
URL https://skcript.com/robots.txt
Redirect https://www.skcript.com/robots.txt
Redirect Domain www.skcript.com
Redirect Base skcript.com
Domain IPs 104.21.58.247, 172.67.166.128, 2606:4700:3032::ac43:a680, 2606:4700:3037::6815:3af7
Redirect IPs 104.21.58.247, 172.67.166.128, 2606:4700:3032::ac43:a680, 2606:4700:3037::6815:3af7
Response IP 172.67.166.128
Found Yes
Hash 186b6ab7c5eae0814c6bdc2307cee496f6478aa00f737988943a4aa52fb93a96
SimHash 654cce70f5b0

Groups

*

Rule Path
Allow /

*
adsbot-google

Rule Path
Disallow /cdn-cgi/
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /cdn-cgi/images/trace/
Disallow /cdn-cgi/rum
Disallow /cdn-cgi/scripts/
Disallow /cdn-cgi/styles/
Disallow /cdn-fpw/sxg/

adsbot-google

Rule Path
Disallow /*.woff2

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
mj12bot
ahrefsbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.skcript.com/sitemap-index.xml
Back to top

Comments

  • _ _ ___ _ _ ___ _____ ___ _____ _____
  • ( ) ( )( _`\ ( ) ( ) | _`\ ( _ )( _`\ ( _ )(_ _)
  • | |_| || (_(_)`\`\_/'/' | (_) )| ( ) || (_) )| ( ) | | |
  • | _ || _)_ `\ /' | , / | | | || _ <'| | | | | |
  • | | | || (_( ) | | | |\ \ | (_) || (_) )| (_) | | |
  • (_) (_)(____/' (_) (_) (_)(_____)(____/'(_____) (_)
  • ___ ___ _ _ _ ___ ___ _ _ ___ _____ _ _ _
  • ( _`\ ( _`\ ( ) ( )(_)( _`\ ( _`\ ( ) ( )( _`\ ( _ )( ) ( ) /'_`\
  • | (_) )| (_(_) | `\| || || ( (_)| (_(_) `\`\_/'/'| (_(_)| (_) || |_| |(_) ) |
  • | _ <'| _)_ | , ` || || | _ | _)_ `\ /' | _)_ | _ || _ | /'/'
  • | (_) )| (_( ) | |`\ || || (_( )| (_( ) _ | | | (_( )| | | || | | | |_|
  • (____/'(____/' (_) (_)(_)(____/'(____/'(_) (_) (____/'(_) (_)(_) (_) (_)
  • *
  • Host
  • ----
  • Sitemaps
  • --------
  • Directories
  • -----------
  • User-agent: GPTBot
  • Disallow: /
  • Block leaky Cloudflare endpoints
  • --------------------------------
  • Stop crawling fonts
  • -------------------
  • Ban noisy bots
  • --------------
Back to top

Warnings

  • `host` is not a known field.
Back to top