fibre2fashion.com
robots.txt

Robots Exclusion Standard data for fibre2fashion.com

Resource Scan

Scan Details

Site Domain fibre2fashion.com
Base Domain fibre2fashion.com
Scan Status Ok
Last Scan2024-06-11T08:12:28+00:00
Next Scan 2024-06-18T08:12:28+00:00

Last Scan

Scanned2024-06-11T08:12:28+00:00
URL https://fibre2fashion.com/robots.txt
Redirect https://www.fibre2fashion.com/robots.txt
Redirect Domain www.fibre2fashion.com
Redirect Base fibre2fashion.com
Domain IPs 13.232.2.71, 13.233.243.1
Redirect IPs 13.232.2.71, 13.233.243.1
Response IP 13.233.243.1
Found Yes
Hash 9c2d0d84065ed01953b1a040197aceb5f1430a0cfcc8635056b47d9675c9235e
SimHash cb14d91a3be8

Groups

nerdbynature.bot

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

spanner

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

cosmos

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mata hari

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

the intraformant

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

webster pro

Rule Path
Disallow /

*

Rule Path
Disallow /services/tablet/

ahrefsbot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

wotbox/2.01

Rule Path
Disallow /

*

Rule Path
Disallow /syndicated-market-research-report/

xovibot

Rule Path
Disallow /

*

Rule Path
Disallow /global-meg-market-outlook/

*

Rule Path
Disallow /news/garment-apparel-news/

*

Rule Path
Disallow /services/promotion/dtp-report/

*

Rule Path
Disallow /runtuchem/

*

Rule Path
Disallow /industry-article/pdffiles

*

Rule Path
Disallow /industry-article/Article/DownloadFile

*

Rule Path
Disallow /industry-article/pdfdownload.asp

*

Rule Path
Disallow /industry-article/printarticle

*

Rule Path
Disallow /news/printstory.aspx

*

Rule Path
Disallow /services/promotion/textile-industry-job/

*

Rule Path
Disallow /services/promotion/automotive-textiles-report/

*

Rule Path
Disallow /services/promotion/home-textiles-report/

*

Rule Path
Disallow /campaigns/

blexbot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /services/mailer/dailynewsalert

*

Rule Path
Disallow /members/googleplusAuth

*

Rule Path
Disallow /members/linkedInAuth

*

Rule Path
Disallow /jobs/jobdata.aspx

*

Rule Path
Disallow /tableaupoc/

*

Rule Path
Disallow /EmbeddedViews/HelloBarGotIt

*

Rule Path
Disallow /news/Index/AMPopUp

*

Rule Path
Disallow /payment/

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /industry-article/apps/

*

Rule Path
Disallow /news/for-you

*

Rule Path
Disallow /industry-article/for-you

*

Rule Path
Disallow /news/NewsData/CaptureUserEvent

Other Records

Field Value
sitemap https://www.fibre2fashion.com/sitemap-index.xml

Warnings

  • 4 invalid lines.