June 19th, 2009, 03:38 PM
Utilizing Perl scripts in a web service app - Performance Considerations
Looking for some insight into the performance of using XML-RPC to run perl scripts via web service.
I am considering buying some perl scripts that have been developed to process large amounts of data as part of a backend ETL to a data warehouse. These scripts currently run as batch jobs via ksh/cron using standard filein/out. I would like to evaluate retooling them into a set of web services (e.g. SOAP, XML-RPC) to be used in an online/realtime transaction mode.
I have done some research and prototyping to confirm that technically, it can be done, but I am concerned about performance/scalability. Seems to me that parsing the XML is going to be the biggest bottleneck. I am sure I can throw hardware at it, but I am wondering if it will be cost effective. We are talking about processing 10Gb/client per day.
Does anyone here have any experience with perl via XML-RPC? Any insight would be appreciated.
Rewriting these perl scripts from the ground up is not an option (too expensive).
In God We Trust....Everything else we backup.
By cheyenne1212 in forum Miscellaneous Security Discussions
Last Post: February 1st, 2012, 01:51 PM
By ThePreacher in forum Miscellaneous Security Discussions
Last Post: December 14th, 2006, 08:37 PM
By Carla in forum Web Security
Last Post: October 31st, 2004, 08:17 AM
By dantesheaven in forum Spyware / Adware
Last Post: October 24th, 2004, 01:49 PM
By Noble Hamlet in forum AntiOnline's General Chit Chat
Last Post: March 17th, 2002, 08:38 AM