DronaBlog

Sunday, September 3, 2023

Org, Secure Agent, and Chicklets in Informatica IDMC

Org

In Informatica IDMC, an org is a logical grouping of users, resources, and data. It is used to manage access to data and applications, and to ensure that data is secure. Each org has its own set of permissions, which define who can access what data and applications.





Secure Agent

The Secure Agent is a software component that runs on a physical or virtual machine in the customer's environment. It is responsible for connecting to the Informatica Cloud and running tasks. The Secure Agent also provides security features, such as encryption and authentication, to protect data in transit and at rest.

Chiclets

Chiclets are small, rectangular icons that represent tasks or applications in Informatica IDMC. They are displayed in the IDMC user interface, and can be used to launch tasks, view data, and manage resources.

How do Orgs, Secure Agents, and Chicklets work together?

Orgs, Secure Agents, and Chicklets work together to provide a secure and scalable environment for data integration.

  • Orgs are used to manage access to data and applications. Each org has its own set of permissions, which define who can access what data and applications.
  • Secure Agents are used to connect to the Informatica Cloud and run tasks. The Secure Agent also provides security features, such as encryption and authentication, to protect data in transit and at rest.
  • Chicklets are used to launch tasks, view data, and manage resources. They are displayed in the IDMC user interface, and can be easily customized to meet the needs of the user.





Benefits of using Orgs, Secure Agents, and Chicklets

There are many benefits to using Orgs, Secure Agents, and Chicklets in Informatica IDMC. These include:

  • Improved security: Orgs and Secure Agents help to protect data by providing a secure environment for data integration.
  • Increased scalability: Chicklets can be used to launch tasks and view data, which can help to improve the scalability of data integration workflows.
  • Improved usability: The IDMC user interface is easy to use and navigate, and chicklets can be customized to meet the needs of the user.

Orgs, Secure Agents, and Chicklets are essential components of Informatica IDMC. They work together to provide a secure and scalable environment for data integration. By using these components, organizations can improve the security, scalability, and usability of their data integration workflows.



Learn more about Informatica MDM Cloud (SaaS) here



Wednesday, August 30, 2023

How to fix error - ERROR: 'Specified alias is not a private key: com.linoma.commons.crypto.CryptoException', while setting up an AS2 Server in IDMC

 Understanding Problem:

When setting up an AS2 Server in IDMC, you may encounter the error message "ERROR: 'Specified alias is not a private key: com.linoma.commons.crypto.CryptoException: Specified alias is not a private key'". 


Root cause:

The error message "Specified alias is not a private key:" may occur if we keep the Decryption Certificate Alias empty. 






Error message:

2023-05-07 11:22:32,388 IST ERROR [AS2MessageWorker] {https-jsse-nio-1.1.1.1-15400-exec-8} Specified alias is not a private key: com.linoma.commons.crypto.CryptoException: Specified alias is not a private key:

        at com.linoma.dpa.crypto.x509.KeyStoreManager.getPrivateKey(KeyStoreManager.java:750)

        at com.linoma.dpa.ghttps.as2.AS2MessageWorker.decryptData(AS2MessageWorker.java:553)

        at com.linoma.dpa.ghttps.as2.AS2MessageWorker.processMessage(AS2MessageWorker.java:158)

        at com.linoma.dpa.ghttps.servlets.AS2Servlet.doPost(AS2Servlet.java:161)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:681)

        at javax.servlet.http.HttpServlet.service(HttpServlet.java:764)

        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)

        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)

        at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)

        at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)

        at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)






Solution: 

You need to provide the decryption alias i.e. private key alias to resolve the issue. Here is screenshot about it




Learn more about Informatica MDM Cloud here





Thursday, August 24, 2023

What is a Secure Agent in Informatica IDMC? Which one is better?

 

What is a Secure Agent in Informatica IDMC?





A Secure Agent is a lightweight program that runs all tasks and enables secure communication across the firewall between Informatica IDMC and the machines where the data resides. It is responsible for managing the connections to the data sources, transferring data, and executing tasks.

Different Types of Secure Agents in Informatica IDMC

There are two types of Secure Agents in Informatica IDMC:

  • Local Secure Agent: This type of agent is installed on a machine within the corporate network. It is the most common type of agent and is used for most data integration tasks.
  • Cloud Secure Agent: This type of agent is hosted in the cloud. It is used for tasks that require access to cloud-based data sources.

Which Secure Agent is Better?

The best type of Secure Agent for a particular task depends on the following factors:

  • The location of the data sources: If the data sources are located in the corporate network, then a Local Secure Agent is the best option. If the data sources are located in the cloud, then a Cloud Secure Agent is the best option.
  • The security requirements: If the data is sensitive, then a Local Secure Agent is the best option because it provides more security. If the data is not sensitive, then a Cloud Secure Agent is a good option because it is more cost-effective.




  • The performance requirements: If the task requires high performance, then a Local Secure Agent is the best option. If the task does not require high performance, then a Cloud Secure Agent is a good option.


Conclusion

The choice of Secure Agent depends on the specific requirements of the task. In general, a Local Secure Agent is the best option for tasks that require access to data sources in the corporate network and have high security requirements. A Cloud Secure Agent is a good option for tasks that require access to cloud-based data sources and are cost-sensitive.

Here are some additional things to consider when choosing a Secure Agent:

  • The number of tasks that need to be run: If you need to run a large number of tasks, then a Local Secure Agent may be the best option because it can handle more concurrent connections.
  • The size of the data sets: If you need to work with large data sets, then a Local Secure Agent may be the best option because it can handle more data throughput.
  • The level of technical expertise: If you have a lot of technical expertise, then you may be able to manage a Cloud Secure Agent yourself. If you do not have a lot of technical expertise, then a Local Secure Agent may be the best option because it is easier to manage.

What is Undermatching in Informatica MDM?

 What is Undermatching in Informatica MDM?

Undermatching is a situation in which two or more records in a master data management (MDM) system do not match, even though they should.



This can happen for a variety of reasons, such as:

  • The records have different values for some of the key attributes.
  • The records have been created by different systems or applications.
  • The records have been corrupted or incorrectly entered.

Undermatching can lead to a number of problems, such as:

  • Inaccurate data analysis.
  • Duplicate data.
  • Poor decision-making.

How to Identify Undermatching

There are a number of ways to identify undermatching in an MDM system. One common approach is to use SQL queries to compare the records in different tables. For example, if the match rule contains both parent (Party) and child (Address) table fuzzy columns. Then try to write sql statement with all the match columns and make sure duplicate records are not returning.


In sql below, we made the assumption that First Name, Last Name from Party table and Address Line 1, Country from Address table are match rule columns.

SQL
select sub1.*, sub2.* from 
(SELECT c.Rowid_object, c.First_Name, c.Last_Name, c.Display_Name, a.Address_Line_1, a.Country, a.State
FROM Customer c
LEFT JOIN Address a
ON c.rowid_object = a.Party_Rowid) sub1,

(SELECT c.Rowid_object, c.First_Name, c.Last_Name, c.Display_Name, a.Address_Line_1, a.Country, a.State
FROM Customer c
LEFT JOIN Address a
ON c.rowid_object = a.Party_Rowid) sub2
WHERE sub1.ROWID_OBJECT <> sub2.ROWID_OBJECT
and sub1.First_Name = sub2.First_Name
and sub1.Last_Name = sub2.Last_Name
and sub1.Address_Line_1 = sub2.Address_Line_1
and sub1.Country = sub2.Country





This query will return a list of all records that are present in the Customer table but found duplicates of those. These records are likely to be undermatched.

Another way to identify undermatching is to use a data profiling tool. Data profiling tools can analyze the data in an MDM system and identify a variety of problems, including undermatching.

How to Fix Undermatching

Once undermatching has been identified, it can be fixed in a number of ways. One common approach is to manually merge the unmatched records. This can be a time-consuming and error-prone process, but it is often the only option when the undermatching is caused by human error.

Another approach is to use automated matching algorithms. These algorithms can compare the records in different tables and identify the ones that are most likely to be matches. Once the matches have been identified, they can be merged automatically.

The best approach to fixing undermatching will depend on the specific situation. However, it is important to fix undermatching as soon as possible to avoid the problems that it can cause.


Learn more about Match process in Informatica MDM here



How to fix error : SDKC_37015 Plug-in Error: Invalid index for transformation type [0]: Should range from [0] to [-1]

 The error message - SDKC_37015 Plug-in Error: Invalid index for transformation type [0]: Should range from [0] to [-1] normally occurs when we try to execute Ingress or egress job in Informatica IDMC ( Intelligent Data Management Cloud ).





a) Error Message:

In order to investigate this issue, we need to check session logs. The session logs will have entry like this -

WRITER_1_*_1> SDKC_37015 [2023-08-17 12:17:24.732] Plug-in Error: Invalid index for transformation type [0]: Should range from [0] to [-1]

WRITER_1_*_1> MDM_10000 [2023-08-17 12:17:25.030] [INFO] JobInstanceId recieved from taskflow is $$jobInstanceId

WRITER_1_*_1> CMN_1761 [2023-08-17 12:17:25.031] Timestamp Event: [Mon Aug 17 12:17:25 2022]

WRITER_1_*_1> MDM_10000 [2023-08-17 12:17:25.031] [ERROR] jobInstanceId is empty or has default value, hence quitting

WRITER_1_*_1> MDM_10000 [2023-08-17 12:17:25.031] [WARNING] Failed to establish connection with the Data Souce.

WRITER_1_*_1> CMN_1761 [2023-08-17 12:17:25.031] Timestamp Event: [Mon Aug 17 12:17:25 2022]

WRITER_1_*_1> MDM_10000 [2023-08-17 12:17:25.031] [ERROR] Connection failed for CCI Client


Notice that there is error related to JobInstanceId - j



obInstanceId recieved from taskflow is $$jobInstanceId


b) How to fix it?

As the issue is related to jobInstanceId, we need to make sure job instance id is available at the below location -

1. Mapping Level - Make sure Inout Parameter jobInstanceId is defined.

2. Mapping Task Level - Make sure Inout Parameter jobInstanceId will be automatically picked from Mapping

3. Taskflow Level - Verify that jobInstanceId has added on both Start and Data Task


Once you fix the jobInstanceId in all these 3 levels, the issue will be resolved. 


Learn more about Informatica MDM Cloud (SaaS) here





Tuesday, August 22, 2023

What is an Org in Informatica IDMC?

 An org in Informatica IDMC is a logical grouping of users, assets, and environments. It is the highest level of administrative grouping in IDMC. Each org has its own set of permissions, licenses, and configurations.





There are three types of orgs in IDMC:

  • Production org: This is the main org where you deploy your production assets.
  • Sandbox org: This is an org used for development and testing.
  • Additional production org: This is an org that can be used to deploy additional production assets.

You can create sub-orgs within an org. Sub-orgs inherit the permissions, licenses, and configurations of the parent org.

The org ID is a unique identifier for an org. You can use the org ID to manage orgs in IDMC.

Why Use Orgs in Informatica IDMC?

There are several benefits to using orgs in Informatica IDMC:

  • Improved security: You can control who has access to what assets and environments by assigning permissions to different orgs. This helps to protect your data and systems from unauthorized access.
  • Increased flexibility: You can create different orgs for different purposes, such as development, testing, and production. This allows you to tailor the permissions and configurations of each org to its specific needs.
  • Reduced costs: You can save money by deploying assets in the most cost-effective org. For example, you might deploy development assets in a less expensive sandbox org, and then deploy production assets in a more expensive production org.





How to Create an Org in Informatica IDMC?

To create an org in Informatica IDMC, you need to:

  1. Log in to the IDMC console.
  2. Click on the Orgs tab.
  3. Click on the Create Org button.
  4. Enter a name and description for the org.
  5. Select the type of org.
  6. Click on the Create button.

How to Manage Orgs in Informatica IDMC?

Once you have created an org, you can manage it by:

  • Adding or removing users.
  • Adding or removing assets.
  • Changing the permissions for users and assets.
  • Changing the configuration of the org.
  • Deleting the org.

Orgs are a powerful tool for managing users, assets, and environments in Informatica IDMC. By using orgs, you can improve security, increase flexibility, and reduce costs.

Learn more about Informatica MDM Cloud (SaaS) here



Thursday, August 17, 2023

What are issues with Secure Agent in Informatica IDMC?

 Issues with the Secure Agent in Informatica IDMC

The Secure Agent is a software component that is used to provide secure communication between Informatica IDMC and the sources and targets that it accesses. It is a critical component of the IDMC infrastructure, and any problems with the Secure Agent can prevent IDMC from working properly.





Here are some of the most common issues with the Secure Agent:

  • The Secure Agent is not installed or configured correctly. This can prevent the Secure Agent from starting or connecting to IDMC.
  • The Secure Agent is not authorized to access the sources and targets that it needs to access. This can prevent the Secure Agent from transferring data.
  • The Secure Agent is not running or is running in a degraded state. This can cause performance problems or prevent IDMC from working altogether.
  • The Secure Agent is infected with malware. This can prevent the Secure Agent from working properly and can also compromise the security of the IDMC environment.

If you are experiencing problems with the Secure Agent, there are a few things you can do to troubleshoot the issue:

  • Check the installation and configuration of the Secure Agent. Make sure that the Secure Agent is installed and configured correctly for your environment.
  • Verify that the Secure Agent is authorized to access the sources and targets that it needs to access.
  • Check the status of the Secure Agent. Make sure that the Secure Agent is running and is not in a degraded state.
  • Scan the Secure Agent for malware. Use a reputable antivirus or anti-malware scanner to scan the Secure Agent for malware.

If you are unable to troubleshoot the issue yourself, you can contact Informatica support for assistance.





Here are some additional tips for preventing problems with the Secure Agent:

  • Keep the Secure Agent up to date. Informatica regularly releases updates for the Secure Agent that address security vulnerabilities and other issues.
  • Use a firewall to protect the Secure Agent. A firewall can help to prevent unauthorized access to the Secure Agent.
  • Monitor the Secure Agent for suspicious activity. Use a monitoring tool to monitor the Secure Agent for suspicious activity, such as unauthorized access or unusual traffic patterns.

By following these tips, you can help to prevent problems with the Secure Agent and ensure that IDMC is able to work properly.


Learn more about Informatica MDM Cloud (SaaS)



Understanding Survivorship in Informatica IDMC - Customer 360 SaaS

  In Informatica IDMC - Customer 360 SaaS, survivorship is a critical concept that determines which data from multiple sources should be ret...