June 19th, 2009, 04:38 PM
Utilizing Perl scripts in a web service app - Performance Considerations
Looking for some insight into the performance of using XML-RPC to run perl scripts via web service.
I am considering buying some perl scripts that have been developed to process large amounts of data as part of a backend ETL to a data warehouse. These scripts currently run as batch jobs via ksh/cron using standard filein/out. I would like to evaluate retooling them into a set of web services (e.g. SOAP, XML-RPC) to be used in an online/realtime transaction mode.
I have done some research and prototyping to confirm that technically, it can be done, but I am concerned about performance/scalability. Seems to me that parsing the XML is going to be the biggest bottleneck. I am sure I can throw hardware at it, but I am wondering if it will be cost effective. We are talking about processing 10Gb/client per day.
Does anyone here have any experience with perl via XML-RPC? Any insight would be appreciated.
Rewriting these perl scripts from the ground up is not an option (too expensive).
In God We Trust....Everything else we backup.
June 20th, 2009, 03:25 PM
my experience of Perl scripts is that if you run them through a certain program, (can't remember what it is called), they come out a lot better.
By cheyenne1212 in forum Miscellaneous Security Discussions
Last Post: February 1st, 2012, 02:51 PM
By ThePreacher in forum Miscellaneous Security Discussions
Last Post: December 14th, 2006, 09:37 PM
By Carla in forum Web Security
Last Post: October 31st, 2004, 09:17 AM
By dantesheaven in forum Spyware / Adware
Last Post: October 24th, 2004, 02:49 PM
By Noble Hamlet in forum AntiOnline's General Chit Chat
Last Post: March 17th, 2002, 09:38 AM