Sqoop
Sqoop is a command-line interface application for transferring data between relational databases and Hadoop.
≈ 4 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Sqoop is a command-line interface application for transferring data between relational databases and Hadoop.[1]
The Apache Sqoop project was retired in June 2021 and moved to the Apache Attic.[2]
Description
edit edit sourceSqoop supports incremental loads of a single table or a free form SQL query as well as saved jobs which can be run multiple times to import updates made to a database since the last import. Imports can also be used to populate tables in Hive or HBase.[3] Exports can be used to put data from Hadoop into a relational database. Sqoop got the name from "SQL-to-Hadoop".[4] Sqoop became a top-level Apache project in March 2012.[5]
Informatica provides a Sqoop-based connector from version 10.1. Pentaho provides open-source Sqoop based connector steps, Sqoop Import[6] and Sqoop Export,[7] in their ETL suite Pentaho Data Integration since version 4.5 of the software.[8] Microsoft uses a Sqoop-based connector to help transfer data from Microsoft SQL Server databases to Hadoop.[9] Couchbase, Inc. also provides a Couchbase Server-Hadoop connector by means of Sqoop.[10]
See also
edit edit sourceReferences
edit edit source- ^ "Hadoop: Apache Sqoop". Retrieved Sep 8, 2012. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "moving Sqoop to the Attic". mail-archives.apache.org. Retrieved 2021-06-27. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Apache Sqoop - Overview". Retrieved Sep 8, 2012. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Introducing Sqoop". Retrieved Jan 1, 2019. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Apache Sqoop Graduates from Incubator". Retrieved Sep 8, 2012. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Sqoop Import". Pentaho. 2015-12-10. Archived from the original on 2015-12-10. Retrieved 2015-12-10. The Sqoop Import job allows you to import data from a relational database into the Hadoop Distributed File System (HDFS) using Apache Sqoop. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Sqoop Export". Pentaho. 2015-12-10. Archived from the original on 2015-12-10. Retrieved 2015-12-10. The Sqoop Export job allows you to export data from Hadoop into an RDBMS using Apache Sqoop. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Big Data Analytics Vendor Pentaho Announces Tighter Integration with Cloudera; Extends Visual Interface to Include Hadoop Sqoop and Oozie". Database Trends and Applications (dbta.com). 2012-07-27. Archived from the original on 2015-12-08. Retrieved 2015-12-08. Pentaho's Business Analytics 4.5 is now certified on Cloudera's latest releases, Cloudera Enterprise 4.0 and CDH4. Pentaho also announced that its visual design studio capabilities have been extended to the Sqoop and Oozie components of Hadoop. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Microsoft SQL Server Connector for Apache Hadoop". Microsoft. Retrieved Sep 8, 2012. Wikipedia revision 1333602511, retrieved 2026-11-18
- ^ "Couchbase Hadoop Connector". Archived from the original on 2012-08-25. Retrieved Sep 8, 2012. Wikipedia revision 1333602511, retrieved 2026-11-18
Bibliography
edit edit source- White, Tom (2010). "Chapter 15: Sqoop". Hadoop: The Definitive Guide (2nd ed.). O'Reilly Media. pp. 477–495. ISBN 978-1-449-38973-4.
External links
edit edit source The Apache Software Foundationprojects
- Accumulo
- ActiveMQ
- Airavata
- Airflow
- Allura
- Ambari
- Ant
- Aries
- Arrow
- Apache HTTP Server
- APR
- Avro
- Axis
- Axis2
- Beam
- Bloodhound
- Brooklyn
- Calcite
- Camel
- CarbonData
- Cassandra
- Cayenne
- CloudStack
- Cordova
- CouchDB
- cTAKES
- CXF
- Derby
- Directory
- Drill
- Druid
- Empire-db
- Felix
- Flex
- Flink
- Flume
- FreeMarker
- Geronimo
- Groovy
- Guacamole
- Gump
- Hadoop
- HBase
- Helix
- Hive
- Iceberg
- Ignite
- Impala
- Jackrabbit
- James
- Jena
- JMeter
- Kafka
- Kudu
- Kylin
- Lucene
- Mahout
- Maven
- MINA
- mod_perl
- MyFaces
- Mynewt
- NiFi
- NetBeans
- Nutch
- NuttX
- OFBiz
- Oozie
- OpenEJB
- OpenJPA
- OpenNLP
- OрenOffice
- ORC
- PDFBox
- Parquet
- Phoenix
- POI
- Pig
- Pinot
- Pivot
- Qpid
- Roller
- RocketMQ
- Samza
- Shiro
- SINGA
- Sling
- Solr
- Spark
- Storm
- SpamAssassin
- Struts
- Subversion
- Superset
- SystemDS
- Tapestry
- Thrift
- Tika
- TinkerPop
- Tomcat
- Trafodion
- Traffic Server
- UIMA
- Velocity
- Wicket
- Xalan
- Xerces
- XMLBeans
- Yetus
- ZooKeeper
Text derived from https://en.wikipedia.org/w/index.php?oldid=1333602511 under CC BY-SA 4.0; modifications have been made.