tag:blogger.com,1999:blog-36012998733063616622024-03-14T00:29:04.861+07:00Learn with Agung PambudiCode for software applications. Programming helps you understand computers.Agung Pambudihttp://www.blogger.com/profile/15420770712075886008noreply@blogger.comBlogger35125tag:blogger.com,1999:blog-3601299873306361662.post-57611257173010685212019-07-12T14:12:00.000+07:002019-07-12T14:12:53.900+07:00Error Accessing Local Site on Windows 8.1, with IIS 8.5
Problem
I get the same error when accessing a local site on my 2008 server, with IIS 7:
HTTP Error 500.19 - Internal Server Error
The requested page cannot be accessed because the related configuration data for the page is invalid.
Module IIS Web Core
Notification BeginRequest
Handler Not yet determined
Error Code 0x80070021
Config Error This configuration section cannot be used at Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-91979823258322625072019-07-12T14:10:00.001+07:002019-07-12T14:10:50.049+07:00Java Server Page DebuggingDoes anyone know how to debug JSP in IntelliJ IDEA?
When I set breakpoint in my JSP files, those breakpoints never seem to take effect. The debugger never hits them. IDEA seems to think that the breakpoints are valid. I do see a red dot placed to the left of the line where I place my breakpoint.
I read in IntelliJ forum in this post that JSP files need to be under web-inf for debugging to work.Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-22985259704085054222019-07-12T14:07:00.000+07:002019-07-12T14:07:25.634+07:00SQLPlus TroubleshootingMy sequence of steps for troubleshooting
1. Is the listener resolvable? C:\>tnsping MYDB (Confirms: the database listener is running on serverside)
2. Is there a firewall issue? C:\>telnet hostname 1521
3. Can I login? C:\>sqlplus system/pass@MYDB or C:\>sqlplus system/pass@hostname:1521/MYDB (Confirms: The database is open)
4. Finally, chances of having a successful login with Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-88503607032959220322019-07-12T10:38:00.001+07:002019-07-12T10:38:47.070+07:00Selection Techniques - Partial Text Filter or RegEx FilterHi,
How can I add a Text Filter that matches a partial text or a pattern?
For example, if I wanted to capture the dimensions of a TV.
How could I create a text filter for an element that matches "TV (WxHxD)" or "TV without stand (WxHxD)"?
How could I create a text filter that contains a partial text like "TV" for a string "TV (WxHxD)"?
Could I run a RegEx to the Text Filter?
Check out the Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-43949339475289282932019-07-12T10:36:00.002+07:002019-07-12T10:36:58.864+07:00Linkarea and Substring FunctionI have a template that is a LinkArea.
I want to activate only the links that start with a specific text. E.g. V65
See attached screendump.
The XPath is curently /A[.]='V65'
However the name of the links are: V65 (Tä), V65 (Mp), V65 (Ax)
I want to compare the first 3 characters of each link name to V65. What should I do? In VB Script I would just write Left(/A[.],3)...
Thanks for any help :-Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-46048486912766991412019-07-12T10:33:00.000+07:002019-07-12T10:33:07.877+07:00Selection Techniques - Can parts of text be filter during extractionWhile pulling data on dollar amounts owed I noticed that the data pulled is text, is there a way to specify this as a number so that the Dollar sign does not get pulled with it. So fo example right now I am pulling '$100' but I just want it to be '100'.
Solution:
Hi,
I should mention I tried using the xpath replace function on the first entry by rewriting the xpath to:
//TBODY/TR[4]/TD[2][Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-7655129165865555952019-07-12T10:31:00.000+07:002019-07-12T10:31:55.827+07:00How To Replace Something with New Contents in PageI added a new 'trans' transformation element , it will replace something with new contents in page.
the 'trans' element has Regex script to transform original html :
<P>&nbsp;</P>
replace <P>&nbsp;</P><hr>
<P>c/o E\. Höpli und S\. Oehler</P>
replace
Afterwards, "c/o E. Höpli und S. Oehler" is replaced by empty string, the order of paragraph Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-20306280127765422632015-09-03T09:45:00.001+07:002015-09-03T09:45:20.272+07:00VirtualBox-4.1.40 Stops WorkingVirtualbox error STATUS_OBJECT_NAME_NOT_FOUND
I am trying to explore virtualbox, while creating a virtual machine using VirtualBox on Windows 8.1 -the got these errors which stopped me many hours I have to say-:
NtCreateFile(\Device\VBoxDrvStub) failed: 0xc0000034
STATUS_OBJECT_NAME_NOT_FOUND (0 retries)
Driver is probably stuck stopping/starting. Try 'sc.exe query vboxdrv' to get more Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-63187377712731194212015-08-17T18:05:00.002+07:002015-08-17T18:05:58.249+07:00Unknown Command: Crawl Error while using ScrapyThere is something missing in installation : scrapy.cfg
You should run scrapy crawl spider_name command being in a scrapy project folder, where scrapy.cfg
You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:
$ scrapy startproject craigslist_sample
$ cd craigslist_sample/
$ ls
craigslist_sample &Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-84578756672529092552015-08-17T17:24:00.000+07:002015-08-17T17:24:49.862+07:00Using XPATH Contains Functionif I had a section of HTML I was trying to scrape like this:
<SPAN id=ctl00_MainContent_gvSearch_Result_ctl09_lblDescription class=smallbold>VGA video cable</SPAN>
The automatic XPATH is this:
//TD[@class='textSmall']/SPAN[2]
While that does work most of the time, sometimes it gathers additional fields depending on search results, or misses the desired selection entirely. I've Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-90827554375935322962015-08-17T17:23:00.000+07:002015-08-17T17:23:29.051+07:00Wait For an Specific Element or Templateif you'd like to wait for an specific element / template,you can mark check "wait for element" option in Misc tab, by default, the timeout for "wait for element" is equal to "ajax call timeout" = 30 secs in global settings, you can enable "Wait script" to set specific timeout , as long as the specific timeout is less than the global one, it won't raise any error even it 's failed to wait.Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-81556352634309442492015-08-17T17:19:00.000+07:002015-08-17T17:19:48.536+07:00Parameterize Proxy via Command LineWe're currently running few projects using the command line utility.
And I want to give in proxy address and port, because the website owners do not want web scraping tools to extract data from their websites.
C:\Program Files (x86)\Visual Web Ripper\RunProject.exe "C:\My Custom Folder Folder\ProjectName.rip" -proxy "50.21.10.78:8800"
For Proxy option, you can configure it in specific Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-17119563631725675592015-07-02T12:16:00.000+07:002015-07-02T12:16:06.699+07:00The OraOLEDB.Oracle provider is not registered on the local machineI am trying to connect my Visual Web Ripper installation to an Oracle database on our company's network. The connection string that I am using is:
Provider=OraOLEDB.Oracle;Data Source=1.2.3.4:5678:mydatabase;User Id=user;Password=password;
Unfortunately, I am unable to connect to the database, and I am getting the following error:
The 'OraOLEDB.Oracle' provider is not registered on the local Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com1tag:blogger.com,1999:blog-3601299873306361662.post-40011582650600367742015-06-11T00:04:00.000+07:002015-06-11T00:39:50.971+07:00Error MessagesI'm getting this error message on projects that used to work correctly before.
The message says:
I get this error in a lot of projects. In som of them in can just bypass this problem by ignoring the message and proceeding in the project normally. But in other cases I just reloads the same page and refuses to proceed.
Custom script error: The given key was not present in the dictionary.Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-13212626059027334972015-05-31T05:28:00.001+07:002015-05-31T05:48:02.449+07:00Using Visual Web Ripper to Bypass Captcha
How To Bypass Captcha Automatically
To configure your data extraction project for semi-automatic CAPTCHA processing, you need to do the following:
Add a content element that selects the CAPTCHA image. Then use the Misc options tab to uncheck the Save content option.
Add a FormField element that selects the CAPTCHA input field. Then use the AdvancedOptions tab to select the image elementAgung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com2tag:blogger.com,1999:blog-3601299873306361662.post-30885681847778125262015-05-30T23:00:00.002+07:002015-05-31T15:48:29.842+07:00How To Bypass Captcha Automatically
CAPTCHAs. (source: www.extremetech.com)
If you don’t want to use the DeathByCaptcha service you can substitute it with some OCR software like GSA Capture Breaker or Captcha Sniper. It simulates the service locally, allowing you to not pay per each captcha recognition.
which captcha type needs to be solved so there is no need to select any
captcha types. I am using Captcha Sniper.
You Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-53080212185951826902015-05-24T23:34:00.002+07:002015-05-29T23:57:53.633+07:00Overview of Selenium Technique in R
I am interested in using Selenium with R. I note that the various documentation. In the documentation it notes about running a selenium server and one can use it to boost web navigation and to ease the path.
Accessing Selenium functionality from within R is possible via the Rwebdriver package.
Selenium. (source: www.ninthavenue.com.au)
# XPath expression for the button element, /Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-30183091414220818582015-05-23T21:07:00.001+07:002015-05-26T01:58:32.550+07:00Export R results to Oracle DatabaseR is a programming language, so there is no limit for the user to use procedure which is only found in standard packages. R is object-oriented and have a lot of very useful libraries developed by contributor.
R. (source: www.coursera.org)
RODBC is an R package that implements ODBC database connectivity.
R> install.packages("RODBC")
R> library(RODBC)
R> con <- odbcConnect("DD1"Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-40303523184772724942015-05-23T19:39:00.001+07:002015-05-29T00:21:38.585+07:00Extract Text Using Regular Expression in R
Use the new stringr package which wraps all the existing regular expression operates in a consistent syntax and adds a few that are missing:
Regex. (source: blog.cmstutorials.org)
R> library(stringr)
R> str_locate("aaa12xxx", "[0-9]+")
# start end
# [1,] 4 5
R> str_extract("aaa12xxx", "[0-9]+")
# [1] "12"
or
R> gsub("[^0-9]", "", "aaa12xxxx")
# [1] "12"
Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-4123851901600564622015-05-23T19:24:00.000+07:002015-05-30T20:53:05.332+07:00Executing R scripts on Windows Task Scheduler I have written an R script that pulls some data, performs several operations on it and post the output to a database. I would like this script to run every day at a specific time and I found any way to do this effectively. I am running this script on a Windows machine.
Task Scheduler. (source: microsoft.com)
Actually under Windows you do not even have to create a batch file first to use theAgung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-85444674833303282712015-05-23T19:07:00.002+07:002015-05-30T01:20:01.379+07:00How To Use XPath within RxpathSApply is a version of xpathApply which attempts to simplify the result if it can be converted to a vector or matrix rather than left as a list. In this way, it has the same relationship to xpathApply as sapply has to lapply.
XPath. (source: tech.amikelive.com)
My code within R:
R> doc <- htmlParse("http://forums.epicgames.com/archive/index.php/t-672775.html")
R> Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-59589547872714103792015-05-23T17:06:00.002+07:002015-05-30T21:50:49.051+07:00Windows Task Scheduler Result Codes
How to troubleshoot scheduled tasks in Windows. If scheduled tasks do not run, you can use these result codes to determine the source of the problem.
You can obtain a full explanation of all Windows completion codes from MSDN, but the common codes for scheduled tasks are:
Windows Task Scheduler. (source: www.wikimedia.org)
SCHED_S_TASK_READY
0x00041300
The task is ready to run at itsAgung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-3935328362087218922015-05-23T16:49:00.000+07:002015-05-26T02:09:00.517+07:00Task Scheduler on LinuxI was looking for ways to make the schedule task in Linux. Finally, I found it. Here are the stages making schedule task in Linux.
cron is the Linux command-line scheduler. Use crontab -e to create (or edit) your cron jobs.
Using Cron
To use cron for tasks meant to run only for your user profile, add entries to your own user's crontab file. Start the crontab editor from a terminal window:
$ Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-640267422155645512015-05-23T15:13:00.001+07:002015-05-23T15:13:52.327+07:00The Most Useful of A Group TemplateWhen I attempt to open the group template, nothing happens.
A group template is an container to iterate through all input items from CSV file other input data source, a typical case is that you can create sub-templates/elements after the group template , then you feed the all input items from the group template in to form field or link template by configs or script transformation, after Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0tag:blogger.com,1999:blog-3601299873306361662.post-42523154866594965672015-05-23T14:53:00.002+07:002015-05-23T14:53:28.911+07:00How To Create Custom XPath Functionsuse 'mod' function in xpath
I am trying to select a list of elements through the following xpath: div[position() mod 2 = 1] and its not working!! But I am able to select the elements using div[position() = 1] or div[position() > 1]. Please help as I need to select elements from position "n" (even or odd).
In VWR, 'mod' operator doesn't work within the xpah .
You could write a custom xpath Agung Pambudihttp://www.blogger.com/profile/16256590952821471401noreply@blogger.com0