samedi 20 octobre 2018

Web scraping different links at same time with php DOMparser

I am trying to web-scrape on this web-site. There are 11 main links which is going different web-sites.

  [0]=>
  string(41) "https://www.mecsumai.com/tpho-mikunigaoka"
  [1]=>
  string(47) "https://www.mecsumai.com/tph-minamisenri-arena/"
  [2]=>
  string(46) "http://www.sekisuihouse.co.jp/gm/osa/umeda871/"
  [3]=>
  string(46) "http://www.sekisuihouse.co.jp/gm/osa/tower287/"
  [4]=>
  string(43) "https://www.mecsumai.com/tph-sumiyoshigawa/"
  [5]=>
  string(39) "https://www.mecsumai.com/tph-sannomiya/"
  [6]=>
  ...

when I enter those web-sites, one more time I need to catch some links. Some of those are onclicks or javascript/links. When I enter those links too. This time I need to catch a iframe, but that I frame contains redirect link.

In the end I need to dive three times. Each page different. I having trouble to handle this. Trying to use DOMparser, but i can't catch javascript/link or on-click or my file_get_contents can't handle redirected links. Is this really possible with the php DOMparser or do I need to use another parser? I am really stuck this. I appreciate any help. Thank you!

P.s: I am using Laravel, so I need to use php in the model. can't use javascript, I think?



via Chebli Mohamed

Aucun commentaire:

Enregistrer un commentaire