Log In Sign Up

finmodelslab.com
robots.txt

Robots Exclusion Standard data for finmodelslab.com

Resource Scan

Scan Details

Site Domain finmodelslab.com
Base Domain finmodelslab.com
Scan Status Ok
Last Scan2025-05-18T04:30:53+00:00
Next Scan 2025-05-25T04:30:53+00:00

Last Scan

Scanned2025-05-18T04:30:53+00:00
URL https://finmodelslab.com/robots.txt
Domain IPs 23.227.38.32, 2620:127:f00f:5::
Response IP 23.227.38.32
Found Yes
Hash aa848097b83e2f212fa7f51407476b5898534b034f687774278d3b3c83bd499f
SimHash 7d5cd652dc98

Groups

*

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /52261912762/checkouts
Disallow /52261912762/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /recommendations/products
Disallow /*/recommendations/products
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /orders
Disallow /52261912762/checkouts
Disallow /52261912762/orders
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /cdn/wpm/*.js
Disallow */collections/all*
Disallow */collections/all*
Disallow */collections/vendors*?*q=*
Disallow */collections/types*?*q=*
Disallow */collections/*?*constraint*
Disallow */collections/*/*
Disallow */collections/*?*filter*
Disallow */collections/*?*pf_*
Disallow */collections/*?*view*
Disallow */collections/*?*grid_list*
Disallow */blogs/*/tagged/*
Disallow */*?jdgm*
Disallow */*?utm_*
Disallow */wpm%40*
Disallow */*?variant*
Disallow */*?pr_prod_strat*
Disallow */collections/*sort_by*
Disallow */collections/*/products/*
Disallow */search?*
Disallow */*.atom
Disallow /de/
Disallow /hi/
Disallow /ar/
Disallow /pt/

adsbot-google

Rule Path
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /orders
Disallow /52261912762/checkouts
Disallow /52261912762/orders
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /cdn/wpm/*.js

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /52261912762/checkouts
Disallow /52261912762/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /a/downloads/-/*
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /52261912762/checkouts
Disallow /52261912762/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow */collections/*filter*%26*filter*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ia_archiver

Rule Path
Disallow /

googledocs

Rule Path
Disallow /

alexabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

wget

Rule Path
Disallow /

httrack

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sogou

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

facebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

backweb

Rule Path
Disallow /

downloader

Rule Path
Disallow /

webdownloader

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

offline navigator

Rule Path
Disallow /

extreme picture finder

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

w3af

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

grabber

Rule Path
Disallow /

arachni

Rule Path
Disallow /

aibolit

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://finmodelslab.com/tools/sitemap-builder/sitemap.xml
Back to top