Skip Menu |
 

This queue is for tickets about the WWW-Scripter CPAN distribution.

Report information
The Basics
Id: 79855
Status: resolved
Priority: 0/
Queue: WWW-Scripter

People
Owner: Nobody in particular
Requestors: nathan [...] chaneylaw.com
Cc:
AdminCc:

Bug Information
Severity: (no value)
Broken in: (no value)
Fixed in: (no value)



CC: sprout [...] cpan.org
Subject: JE::Object::Proxy error when using WWW::Scripter
Date: Tue, 25 Sep 2012 18:00:33 -0500
To: bug-WWW-Scripter [...] rt.cpan.org
From: Nathan Chaney <nathan [...] chaneylaw.com>
Download (untitled) / with headers
text/plain 1.8k
I'm trying to use WWW::Scripter with the Ajax plugin to scrape the information from a webpage. It is my understanding that the get method retrieves the HTML, executes the AJAX code, and makes the response available through the content method. Here's my code: #!/usr/bin/perl -w use strict; use WWW::Scripter; ###### Scripting declarations ############# my $w = new WWW::Scripter; $w->use_plugin('Ajax'); ####### Redirect output of curl to WHILE loop; reads USPTO web page line-by-line my $url='http://tsdr.uspto.gov/#caseNumber=85304498&caseType=SERIAL_NO&searchType=statusSearch'; $w->get($url); print $w->content; The resulting content will be parsed by Perl (this is test code — there are lots of these pages I'm trying to automatically parse). I've already written the Perl code to parse the page, and the site recently switched from server-side execution to an AJAX-based implementation. The AJAX code appears to automatically populate the page when the variables are set in the URL indicated above. That is, no form submission is required in a browser when the URL above is used. This code returns the following error during the get method: Error: Can't locate object method "style" via package "JE::Object::Proxy" at /Library/Perl/5.10.0/CSS/DOM.pm line 155. TypeError: The object's 'widget' property (undefined) is not a function at http://tsdr.uspto.gov/js/lib/jquery.multiselect.js, line 647. Then, the code prints the HTML as it appears before the AJAX code populates the appropriate <div> tag. It returns the content but not, as the WWW::Scripter documentation indicates, after it has been modified by scripts. It is not a function of enabling fetch_images, because I tried that. Is this a bug? Or am I missing a step required to evaluate the AJAX code on the page? Thanks, Nathan -- Nathan Chaney Registered Patent Attorney | www.chaneylaw.com (870) 246-0600 telephone | (866) 734-0971 facsimile
Subject: Re: [rt.cpan.org #79855] AutoReply: JE::Object::Proxy error when using WWW::Scripter
Date: Tue, 25 Sep 2012 23:41:27 -0500
To: "bug-WWW-Scripter [...] rt.cpan.org" <bug-WWW-Scripter [...] rt.cpan.org>
From: Nathan Chaney <nathan [...] chaneylaw.com>
Never mind. I found another way to do it. Sorry for bothering you. -- Nathan Chaney Registered Patent Attorney | www.chaneylaw.com (870) 246-0600 telephone | (866) 734-0971 facsimile On Sep 25, 2012, at 18:00, "Bugs in WWW-Scripter via RT" <bug-WWW-Scripter@rt.cpan.org> wrote: Show quoted text
> > Greetings, > > This message has been automatically generated in response to the > creation of a trouble ticket regarding: > "JE::Object::Proxy error when using WWW::Scripter", > a summary of which appears below. > > There is no need to reply to this message right now. Your ticket has been > assigned an ID of [rt.cpan.org #79855]. Your ticket is accessible > on the web at: > > https://rt.cpan.org/Ticket/Display.html?id=79855 > > Please include the string: > > [rt.cpan.org #79855] > > in the subject line of all future correspondence about this issue. To do so, > you may reply to this message. > > Thank you, > bug-WWW-Scripter@rt.cpan.org > > ------------------------------------------------------------------------- > I'm trying to use WWW::Scripter with the Ajax plugin to scrape the information from a webpage. It is my understanding that the get method retrieves the HTML, executes the AJAX code, and makes the response available through the content method. > > Here's my code: > > #!/usr/bin/perl -w > > use strict; > use WWW::Scripter; > > ###### Scripting declarations ############# > my $w = new WWW::Scripter; > $w->use_plugin('Ajax'); > > ####### Redirect output of curl to WHILE loop; reads USPTO web page line-by-line > my $url='http://tsdr.uspto.gov/#caseNumber=85304498&caseType=SERIAL_NO&searchType=statusSearch'; > $w->get($url); > print $w->content; > > The resulting content will be parsed by Perl (this is test code — there are lots of these pages I'm trying to automatically parse). I've already written the Perl code to parse the page, and the site recently switched from server-side execution to an AJAX-based implementation. The AJAX code appears to automatically populate the page when the variables are set in the URL indicated above. That is, no form submission is required in a browser when the URL above is used. > > This code returns the following error during the get method: > > Error: Can't locate object method "style" via package "JE::Object::Proxy" at /Library/Perl/5.10.0/CSS/DOM.pm line 155. > TypeError: The object's 'widget' property (undefined) is not a function at http://tsdr.uspto.gov/js/lib/jquery.multiselect.js, line 647. > > Then, the code prints the HTML as it appears before the AJAX code populates the appropriate <div> tag. It returns the content but not, as the WWW::Scripter documentation indicates, after it has been modified by scripts. > > It is not a function of enabling fetch_images, because I tried that. > > Is this a bug? Or am I missing a step required to evaluate the AJAX code on the page? > > Thanks, > Nathan > -- > Nathan Chaney > Registered Patent Attorney | www.chaneylaw.com > (870) 246-0600 telephone | (866) 734-0971 facsimile > >
Download (untitled) / with headers
text/plain 3.6k
On Wed Sep 26 00:41:42 2012, nathan@chaneylaw.com wrote: Show quoted text
> Never mind. I found another way to do it. Sorry for bothering you.
I’m glad to hear you found a solution. However, I suspect there *is* a bug in one of my modules. If it’s not too inconvenient, could you attach to this ticket the script at <http://tsdr.uspto.gov/js/lib/jquery.multiselect.js>? (I have limited web access.) That may be enough for me to track down the issue. Thank you. Show quoted text
> > -- > Nathan Chaney > Registered Patent Attorney | www.chaneylaw.com > (870) 246-0600 telephone | (866) 734-0971 facsimile > > On Sep 25, 2012, at 18:00, "Bugs in WWW-Scripter via RT" <bug-WWW- > Scripter@rt.cpan.org> wrote: >
> > > > Greetings, > > > > This message has been automatically generated in response to the > > creation of a trouble ticket regarding: > > "JE::Object::Proxy error when using WWW::Scripter", > > a summary of which appears below. > > > > There is no need to reply to this message right now. Your ticket
> has been
> > assigned an ID of [rt.cpan.org #79855]. Your ticket is accessible > > on the web at: > > > > https://rt.cpan.org/Ticket/Display.html?id=79855 > > > > Please include the string: > > > > [rt.cpan.org #79855] > > > > in the subject line of all future correspondence about this issue.
> To do so,
> > you may reply to this message. > > > > Thank you, > > bug-WWW-Scripter@rt.cpan.org > > > >
> ---------------------------------------------------------------------
---- Show quoted text
> > I'm trying to use WWW::Scripter with the Ajax plugin to scrape the
> information from a webpage. It is my understanding that the get > method retrieves the HTML, executes the AJAX code, and makes the > response available through the content method.
> > > > Here's my code: > > > > #!/usr/bin/perl -w > > > > use strict; > > use WWW::Scripter; > > > > ###### Scripting declarations ############# > > my $w = new WWW::Scripter; > > $w->use_plugin('Ajax'); > > > > ####### Redirect output of curl to WHILE loop; reads USPTO web page
> line-by-line
> > my
>
$url='http://tsdr.uspto.gov/#caseNumber=85304498&caseType=SERIAL_NO&searchType=st atusSearch'; Show quoted text
> > $w->get($url); > > print $w->content; > > > > The resulting content will be parsed by Perl (this is test code —
> there are lots of these pages I'm trying to automatically parse). > I've already written the Perl code to parse the page, and the site > recently switched from server-side execution to an AJAX-based > implementation. The AJAX code appears to automatically populate the > page when the variables are set in the URL indicated above. That > is, no form submission is required in a browser when the URL above > is used.
> > > > This code returns the following error during the get method: > > > > Error: Can't locate object method "style" via package
> "JE::Object::Proxy" at /Library/Perl/5.10.0/CSS/DOM.pm line 155.
> > TypeError: The object's 'widget' property (undefined) is not a
> function at http://tsdr.uspto.gov/js/lib/jquery.multiselect.js, > line 647.
> > > > Then, the code prints the HTML as it appears before the AJAX code
> populates the appropriate <div> tag. It returns the content but > not, as the WWW::Scripter documentation indicates, after it has > been modified by scripts.
> > > > It is not a function of enabling fetch_images, because I tried that. > > > > Is this a bug? Or am I missing a step required to evaluate the AJAX
> code on the page?
> > > > Thanks, > > Nathan > > -- > > Nathan Chaney > > Registered Patent Attorney | www.chaneylaw.com > > (870) 246-0600 telephone | (866) 734-0971 facsimile > > > >
Subject: Re: [rt.cpan.org #79855] JE::Object::Proxy error when using WWW::Scripter
Date: Mon, 1 Oct 2012 12:13:55 -0500
To: bug-WWW-Scripter [...] rt.cpan.org
From: Nathan Chaney <nathan [...] chaneylaw.com>
Here's the file you requested. Good luck. -- Nathan Chaney Registered Patent Attorney | www.chaneylaw.com (870) 246-0600 telephone | (866) 734-0971 facsimile On Sep 30, 2012, at 8:44 PM, Father Chrysostomos via RT <bug-WWW-Scripter@rt.cpan.org> wrote: Show quoted text
> <URL: https://rt.cpan.org/Ticket/Display.html?id=79855 > > > On Wed Sep 26 00:41:42 2012, nathan@chaneylaw.com wrote:
>> Never mind. I found another way to do it. Sorry for bothering you.
> > I’m glad to hear you found a solution. However, I suspect there *is* a bug in one of my > modules. If it’s not too inconvenient, could you attach to this ticket the script at > <http://tsdr.uspto.gov/js/lib/jquery.multiselect.js>? (I have limited web access.) That may > be enough for me to track down the issue. Thank you. >
>> >> -- >> Nathan Chaney >> Registered Patent Attorney | www.chaneylaw.com >> (870) 246-0600 telephone | (866) 734-0971 facsimile >> >> On Sep 25, 2012, at 18:00, "Bugs in WWW-Scripter via RT" <bug-WWW- >> Scripter@rt.cpan.org> wrote: >>
>>> >>> Greetings, >>> >>> This message has been automatically generated in response to the >>> creation of a trouble ticket regarding: >>> "JE::Object::Proxy error when using WWW::Scripter", >>> a summary of which appears below. >>> >>> There is no need to reply to this message right now. Your ticket
>> has been
>>> assigned an ID of [rt.cpan.org #79855]. Your ticket is accessible >>> on the web at: >>> >>> https://rt.cpan.org/Ticket/Display.html?id=79855 >>> >>> Please include the string: >>> >>> [rt.cpan.org #79855] >>> >>> in the subject line of all future correspondence about this issue.
>> To do so,
>>> you may reply to this message. >>> >>> Thank you, >>> bug-WWW-Scripter@rt.cpan.org >>> >>>
>> ---------------------------------------------------------------------
> ----
>>> I'm trying to use WWW::Scripter with the Ajax plugin to scrape the
>> information from a webpage. It is my understanding that the get >> method retrieves the HTML, executes the AJAX code, and makes the >> response available through the content method.
>>> >>> Here's my code: >>> >>> #!/usr/bin/perl -w >>> >>> use strict; >>> use WWW::Scripter; >>> >>> ###### Scripting declarations ############# >>> my $w = new WWW::Scripter; >>> $w->use_plugin('Ajax'); >>> >>> ####### Redirect output of curl to WHILE loop; reads USPTO web page
>> line-by-line
>>> my
>>
> $url='http://tsdr.uspto.gov/#caseNumber=85304498&caseType=SERIAL_NO&searchType=st > atusSearch';
>>> $w->get($url); >>> print $w->content; >>> >>> The resulting content will be parsed by Perl (this is test code —
>> there are lots of these pages I'm trying to automatically parse). >> I've already written the Perl code to parse the page, and the site >> recently switched from server-side execution to an AJAX-based >> implementation. The AJAX code appears to automatically populate the >> page when the variables are set in the URL indicated above. That >> is, no form submission is required in a browser when the URL above >> is used.
>>> >>> This code returns the following error during the get method: >>> >>> Error: Can't locate object method "style" via package
>> "JE::Object::Proxy" at /Library/Perl/5.10.0/CSS/DOM.pm line 155.
>>> TypeError: The object's 'widget' property (undefined) is not a
>> function at http://tsdr.uspto.gov/js/lib/jquery.multiselect.js, >> line 647.
>>> >>> Then, the code prints the HTML as it appears before the AJAX code
>> populates the appropriate <div> tag. It returns the content but >> not, as the WWW::Scripter documentation indicates, after it has >> been modified by scripts.
>>> >>> It is not a function of enabling fetch_images, because I tried that. >>> >>> Is this a bug? Or am I missing a step required to evaluate the AJAX
>> code on the page?
>>> >>> Thanks, >>> Nathan >>> -- >>> Nathan Chaney >>> Registered Patent Attorney | www.chaneylaw.com >>> (870) 246-0600 telephone | (866) 734-0971 facsimile >>> >>>
> > >
Here's the file you requested. Good luck.

--
Nathan Chaney
Registered Patent Attorney  |  www.chaneylaw.com
(870) 246-0600 telephone   |  (866) 734-0971 facsimile
Download jquery.multiselect.js
text/javascript 18.9k

Message body is not shown because sender requested not to inline it.


On Sep 30, 2012, at 8:44 PM, Father Chrysostomos via RT <bug-WWW-Scripter@rt.cpan.org> wrote:

Show quoted text
<URL: https://rt.cpan.org/Ticket/Display.html?id=79855 >

On Wed Sep 26 00:41:42 2012, nathan@chaneylaw.com wrote:
Never mind. I found another way to do it. Sorry for bothering you.

I’m glad to hear you found a solution.  However, I suspect there *is* a bug in one of my
modules.  If it’s not too inconvenient, could you attach to this ticket the script at
<http://tsdr.uspto.gov/js/lib/jquery.multiselect.js>?  (I have limited web access.)  That may
be enough for me to track down the issue.  Thank you.


--
Nathan Chaney
Registered Patent Attorney  |  www.chaneylaw.com
(870) 246-0600 telephone   |  (866) 734-0971 facsimile

On Sep 25, 2012, at 18:00, "Bugs in WWW-Scripter via RT" <bug-WWW-
  Scripter@rt.cpan.org> wrote:


Greetings,

This message has been automatically generated in response to the
creation of a trouble ticket regarding:
  "JE::Object::Proxy error when using WWW::Scripter",
a summary of which appears below.

There is no need to reply to this message right now.  Your ticket
  has been
assigned an ID of [rt.cpan.org #79855].  Your ticket is accessible
on the web at:

  https://rt.cpan.org/Ticket/Display.html?id=79855

Please include the string:

       [rt.cpan.org #79855]

in the subject line of all future correspondence about this issue.
  To do so,
you may reply to this message.

                      Thank you,
                      bug-WWW-Scripter@rt.cpan.org


  ---------------------------------------------------------------------
----
I'm trying to use WWW::Scripter with the Ajax plugin to scrape the
  information from a webpage. It is my understanding that the get
  method retrieves the HTML, executes the AJAX code, and makes the
  response available through the content method.

Here's my code:

#!/usr/bin/perl -w

use strict;
use WWW::Scripter;

###### Scripting declarations #############
my $w = new WWW::Scripter;
$w->use_plugin('Ajax');

####### Redirect output of curl to WHILE loop; reads USPTO web page
  line-by-line
my

$url='http://tsdr.uspto.gov/#caseNumber=85304498&caseType=SERIAL_NO&searchType=st
atusSearch';
$w->get($url);
print $w->content;

The resulting content will be parsed by Perl (this is test code —
  there are lots of these pages I'm trying to automatically parse).
  I've already written the Perl code to parse the page, and the site
  recently switched from server-side execution to an AJAX-based
  implementation. The AJAX code appears to automatically populate the
  page when the variables are set in the URL indicated above. That
  is, no form submission is required in a browser when the URL above
  is used.

This code returns the following error during the get method:

Error: Can't locate object method "style" via package
  "JE::Object::Proxy" at /Library/Perl/5.10.0/CSS/DOM.pm line 155.
TypeError: The object's 'widget' property (undefined) is not a
  function at http://tsdr.uspto.gov/js/lib/jquery.multiselect.js,
  line 647.

Then, the code prints the HTML as it appears before the AJAX code
  populates the appropriate <div> tag. It returns the content but
  not, as the WWW::Scripter documentation indicates, after it has
  been modified by scripts.

It is not a function of enabling fetch_images, because I tried that.

Is this a bug? Or am I missing a step required to evaluate the AJAX
  code on the page?

Thanks,
Nathan
--
Nathan Chaney
Registered Patent Attorney  |  www.chaneylaw.com
(870) 246-0600 telephone   |  (866) 734-0971 facsimile






Download (untitled) / with headers
text/plain 300b
On Mon Oct 01 13:14:08 2012, nathan@chaneylaw.com wrote: Show quoted text
> Here's the file you requested. Good luck.
Thank you. It took me a while, but I have managed to track down the problem. There are actually bugs in three of my modules. I probably won’t have time to make new releases till the weekend.
Download (untitled) / with headers
text/plain 797b
On Wed Oct 17 16:54:40 2012, SPROUT wrote: Show quoted text
> On Mon Oct 01 13:14:08 2012, nathan@chaneylaw.com wrote:
> > Here's the file you requested. Good luck.
> > Thank you. It took me a while, but I have managed to track down the > problem. There are > actually bugs in three of my modules. I probably won’t have time to > make new releases till the > weekend.
BTW, these are the bugs: • JE’s run-time engine was getting confused by ‘... ? this : ...’. • The JE back end for the JavaScript plugin (WWW::Scripter::Plugin::JavaScript::JE) was not creating a proper binding between the JavaScript engine and WWW::Scripter for window methods like getComputedStyle (resulting in the Proxy object error). • CSS::DOM was generating a spurious uninitialized warning under some circumstances.
On Wed Oct 17 16:59:06 2012, SPROUT wrote: Show quoted text
> On Wed Oct 17 16:54:40 2012, SPROUT wrote:
> > On Mon Oct 01 13:14:08 2012, nathan@chaneylaw.com wrote:
> > > Here's the file you requested. Good luck.
> > > > Thank you. It took me a while, but I have managed to track down the > > problem. There are > > actually bugs in three of my modules. I probably won’t have time to > > make new releases till the > > weekend.
> > BTW, these are the bugs: > > • JE’s run-time engine was getting confused by ‘... ? this : ...’. > • The JE back end for the JavaScript plugin > (WWW::Scripter::Plugin::JavaScript::JE) was not > creating a proper binding between the JavaScript engine and > WWW::Scripter for window > methods like getComputedStyle (resulting in the Proxy object error). > • CSS::DOM was generating a spurious uninitialized warning under some > circumstances.
As a result of your report I have made three new releases: CSS-DOM-0.15.tar.gz WWW-Scripter-Plugin-JavaScript-0.008a.tar.gz JE-0.060.tar.gz Thank you!
Subject: Re: [rt.cpan.org #79855] JE::Object::Proxy error when using WWW::Scripter
Date: Tue, 23 Oct 2012 09:40:22 -0500
To: "bug-WWW-Scripter [...] rt.cpan.org" <bug-WWW-Scripter [...] rt.cpan.org>
From: Nathan Chaney <nathan [...] chaneylaw.com>
Download (untitled) / with headers
text/plain 1.3k
Thanks for the hard work. Glad I could offer a little help! -- Nathan Chaney Registered Patent Attorney | www.chaneylaw.com (870) 246-0600 telephone | (866) 734-0971 facsimile On Oct 23, 2012, at 0:02, "Father Chrysostomos via RT" <bug-WWW-Scripter@rt.cpan.org> wrote: Show quoted text
> <URL: https://rt.cpan.org/Ticket/Display.html?id=79855 > > > On Wed Oct 17 16:59:06 2012, SPROUT wrote:
>> On Wed Oct 17 16:54:40 2012, SPROUT wrote:
>>> On Mon Oct 01 13:14:08 2012, nathan@chaneylaw.com wrote:
>>>> Here's the file you requested. Good luck.
>>> >>> Thank you. It took me a while, but I have managed to track down the >>> problem. There are >>> actually bugs in three of my modules. I probably won’t have time to >>> make new releases till the >>> weekend.
>> >> BTW, these are the bugs: >> >> • JE’s run-time engine was getting confused by ‘... ? this : ...’. >> • The JE back end for the JavaScript plugin >> (WWW::Scripter::Plugin::JavaScript::JE) was not >> creating a proper binding between the JavaScript engine and >> WWW::Scripter for window >> methods like getComputedStyle (resulting in the Proxy object error). >> • CSS::DOM was generating a spurious uninitialized warning under some >> circumstances.
> > As a result of your report I have made three new releases: > > CSS-DOM-0.15.tar.gz > WWW-Scripter-Plugin-JavaScript-0.008a.tar.gz > JE-0.060.tar.gz > > Thank you! >


This service is sponsored and maintained by Best Practical Solutions and runs on Perl.org infrastructure.

Please report any issues with rt.cpan.org to rt-cpan-admin@bestpractical.com.