Hive - Client

Card Puncher Data Processing

List

Steps

# all hadoop technology are installed below the hadoop folder
cd /hadoop

# untar the archive
tar -xvf apache-hive-2.3.2-bin.tar.gz

# Rename the folder because we want to be able to select it when navigating the file system tree with one letter
mv apache-hive-2.3.2-bin/ hive-2.3.2

Sequence of API calls involved to make the first query

In HiveServer2:

  • The client creates a HiveConnection by initiating a transport connection (e.g., TCP connection) followed by an OpenSession API call to get a SessionHandle. The session is created from the server side.
  • The HiveStatement is executed (following JDBC standards) and an ExecuteStatement API call is made from the Thrift client. In the API call, SessionHandle information is passed to the server along with the query information.
  • The HS2 server receives the request and asks the driver (which is a CommandProcessor) for query parsing and compilation. The driver kicks off a background job that will talk to Hadoop and then immediately returns a response to the client. This is an asynchronous design of the ExecuteStatement API. The response contains an OperationHandle created from the server side.
  • The client uses the OperationHandle to talk to HS2 to poll the status of the query execution.





Discover More
Hive System Architecture
Hive - Architecture

Example of System architecture with Map/Reduce as Engine. where: (for UI) Job Tracker: ...
Card Puncher Data Processing
Hive - Connection

A connection is made through: a client via an See for instance Beeline
Card Puncher Data Processing
Hive - Transport Mode

The transport mode is the network protcol used to made a connection HTTP mode is required when a proxy is needed between the client and server (for example, for load balancing or security reasons)....
Card Puncher Data Processing
Hive - URI (Connection URL )

cliservice/confhive.server2.thrift.http.path transportMode : . Default port for HTTP transport mode is 10001. See conf hive.server2.thrift.http.port clientURI Zookeeper Quorum Headnode (Example...



Share this page:
Follow us:
Task Runner