Empowering People with Knowledge

Make Important Decisions by Extracting Knowledge from the Massive Cache of the Public Web

Contact Us   Learn More

1. Extract Knowledge

Extract data at large-scale and process them into valuable knowledge by using Fetch

2. Get Knowledge

Discover & understand relevant knowledge by using Insights

3. Make Decisions

Make important decisions

Products

Some of our product offerings

Fetch

Empowering developers to scrape the web at large-scale by utilizing a massive cache of public web pages

Learn More

# initialize nokogiri
nokogiri = Nokogiri.HTML(content)

# get the listings
listings = nokogiri.css('ul.b-list__items_nofooter li.s-item')

# loop through the listings
listings.each do |listing|
    # save the product info to outputs.
    outputs << {
      _collection: "products",
      title: listing.at_css('h3.s-item__title')&.text,
      price: listing.at_css('.s-item__price')&.text
    }

    # enqueue more pages to be scraped
    pages << {
        url: item_link['href'] unless item_link.nil?,
        page_type: 'details'
      }
end

Insights

Empowering decision makers to discover and understand knowledge through instant answers to their questions

Learn More

 

Contact Us

Say hi and tell us more about your needs

AnswersEngine.com
10 Dundas St E,
Toronto, ON M5B 2G9
Canada
P: +1(347) 835-5558

Answers Engine is a Canadian Based Startup
and is Incubated in the DMZ Incubator
at Ryerson University, Toronto, Canada

© 2018 AnswersEngine.com