c# .net Application Optimize performance of my current web scrapper to get details from heavily loaded website.

[kate]

I want to optimize the performance of my current web scrapper and make it as fast as my competitor's scrapper. The issue I'm facing is when user starts scrapping the site for booking process the book now link is not coming in response while in competitor's application it comes in very first second from heavily loaded web site. Please send me only professional developers and web scrappers. i am ready to pay .

Thanks

Kate

[li0nsar3c00l]

If you know your competitiors do it, just check the request url and parameter

[kate]

@li0nsar3c00l all things are identical 

[akkaldama]

@kate,

Does your application uses any c# library?

Scrapyscharp is much better and i have used it to scrap a 40-page site(site uses pagination) in 20-30 mins(the site contains lots of advertisement ).

[SameerRaj]

@kate You Are TAlking About TAtkal Software TO Book Tatkal Ticket ..?

 

Edited June 16, 2016 by SameerRaj

[kate]

@SameerRaj i am talking about amazon flash sale scraping

[SameerRaj]

@kate ok