BDM - Connection

About

BDM connections:

• HBase (a NoSQL database comprising key-value pairs on Hadoop that performs operations in real-time)
• Hadoop,
• HDFS,
• Hive connections
• JDBC

Articles Related

Managment

With BDM - infacmd

infacmd isp --help

Connection commands
  addConnectionPermissions: Assigns connection permissions to a user or a group.
  createConnection: Defines a connection and the connection options.
  generateHadoopConnectionFromHiveConnection: Generates Hadoop connection from Hive pushdown connections.
  listConnectionOptions: Lists options for a connection.
  listConnectionPermissions: Lists the permissions that a user or group has for a connection.
  listConnectionPermissionsByGroup: Lists all groups that have permissions on a connection and lists the type of permissions.
  listConnectionPermissionsByUser: Lists all users that have permissions on a connection and lists the type of permissions.
  listConnections: Lists connection names by type.
  removeConnection: Removes a connection from the domain.
  removeConnectionPermissions: Removes connection permissions for a user or a group.
  renameConnection: Renames a connection.
  setConnectionPermissions: Assigns permissions on connection to a user or a group after removing previous permissions.
  updateConnection: Updates a connection.

Options

List the properties / parameters/ options of a connection

infacmd.sh isp listConnectionOptions \
  -cn connectionName \
  -DomainName $INFA_DOMAIN_NAME \
  -UserName $INFA_USERNAME \
  -Password $INFA_PASSWORD \
  -sdn $INFA_SECURITY_DOMAIN 

Example with a Hive Connection:

connectionId: [HIVE_HDI_BDM_DEV]
connectionType: [HIVE]
name: [HIVE_HDI]
connectString: [jdbc:hive2://hn0-blabla:10001/default;transportMode=http;httpPath=/;saslQop=auth;principal=hive/_HOST@blabla]
enableQuotes: [false]
environmentSQL: []
metadataConnString: [jdbc:hive2://hn0-blabla:10001/default;transportMode=http;httpPath=/;saslQop=auth;principal=hive/_HOST@blbla]
password: [**********]
quoteChar: [BACK_QUOTE]
userName: [[email protected]]
bypassHiveJDBCServer: [false]
clusterConfigId: [hdi_bdm_dev]
hadoopClusterName: []
hiveJdbcDriverClassName: [org.apache.hive.jdbc.HiveDriver]
sqlAuthorized: [false]

Query

with BDM - Model Repository Service (MRS)

• Connection used in mapping

SELECT CONN_NAME, count(1) FROM MRX_INSTANCE_SOURCES where CONN_NAME is not null group by conn_name order by CONN_NAME;

• Connection defined in Domain

select distinct PSC_DISCRIMINATOR, PSC_EXTERNID from dbo.PO_CONNECTINFO order by PSC_EXTERNID;