Technologies used in Development
Benipal uses opensource software, available publicly for its internal use and research and development of its social e-commerce platform. Some of the technologies we use in our platform and on a daily basis for development are: Solr, Lucene, Elasticsearch, Hadoop, HBase, Spark, Yarn.
Lucene and Elasticsearch Consulting, Solr Consulting
With over 5 years of round the clock development, our team of 3 search engineers created a proprietary search engine based on the lucene and solr source code. Our search engine employs heuristic algorithmic learning techniques developed in-house to help search smarter. Currently in use on the alpha test deployment at www.benipal.com , feel free to check it out and send us your comments.
Hadoop and HBase
We currently run a 35 node cluster with 144 xeon cores, 350 GB RAM and over 20 TB of raw storage capacity at our Bangalore office. Our Hadoop / HBase cluster has been operating with no downtime for over 5 years. Used everyday in our research and development, Hadoop is used for everything from data storage, log parsing to analytics. HBase is our primary database, and while we also use MySQL, HBase remains our primary focus.
MySQL remains our test database where relational integrity is important and acts as a testbed to ultimately replicate the same structures in HBase.
We develop all our code on a end to end spring platform with terracotta, ehCache, Quartz Scheduler and Hibernate.
TerraCotta, EhCache, Hibernate and Quartz
We use open source versions of Terracotta, ehCache, Hibernate and Quartz in our Spring application development.
Groovy and Grails
We use Groovy on a Grails platform for our test applications when time and speed is of the essence. Groovy and Grail aplications serve as a testbed for Spring app development.
Our Primary Coding Language used in everything we do, including MapReduce and HDFS Streaming API.
All UI development is done using html5, css with heavy usage of jquery and Ajax.
Application and Web Servers
We test everything on Glassfish and Tomcat application servers with Nginx and Apache httpd servers as frontend.
All development is done using Netbeans IDE.
CentOS and Ubuntu
Our primary servers run on CentOS 6.3 64 bit and all development is being done on Ubuntu 12.04 64 bit Desktops.
Our Phone Systems run on Asterisk and FreePBX. With over 400 DID's, 120 E1 PRI channels and multiple Incoming Skype SIP trunks currently in use at our Bangalore office, you will never get a busy signal.
Thanks to Apache, the Hadoop and HBase community and all the opensource contributors and people who keep software running the way it should be, so real things can be developed.