CertNexus AIP-210 CertNexus Certified Artificial Intelligence Practitioner (CAIP) Exam Practice Test

A bag of bigrams (2 letter pairs) is an approach to representing features for textual data that involves counting the frequency of each pair of adjacent letters in a text. For example, the word “hello” would be represented as {“he”: 1, “el”: 1, “ll”: 1, “lo”: 1}. A bag of bigrams can capture some information about the spelling and structure of words, which can be useful for identifying the language of a text. For example, some languages have more common bigrams than others, such as “th” in English or “ch” in German .

Random forest is an algorithm that is ideal to prevent overfitting when using a dataset with many features and a small sample size. Random forest is an ensemble learning method that combines multiple decision trees to create a more robust and accurate model. Random forest can prevent overfitting by introducing randomness and diversity into the model, such as by using bootstrap sampling (sampling with replacement) to create different subsets of data for each tree, or by using feature selection (choosing a random subset of features) to split each node in a tree.

An L1 norm is a measure of distance or magnitude that is defined as the sum of the absolute values of the components of a vector. For example, if x and y are two components of a vector, then the L1 norm of that vector is |x| + |y|. The L1 norm is also known as the Manhattan distance or the taxicab distance, as it represents the shortest path between two points in a grid-like city.

Data privacy is the right of individuals to control how their personal data is collected, used, shared, and protected. It also involves complying with relevant laws and regulations that govern the handling of personal data. Data privacy is especially important when extracting business intelligence from primary data captured from the public, as it may contain sensitive or confidential information that could harm the individuals if misused or breached .

Federated learning is a distributed approach to machine learning that allows multiple parties to collaboratively train a model without sharing their data with each other or a central server. This protects the privacy of the user’s data while still enabling well-trained models that can benefit from diverse and large-scale datasets. References: [Federated Learning - Wikipedia], [Federated Learning for Mobile Keyboard Prediction - Google AI Blog]

Normalization is a method that can help us to solve the problem of features being on different scales when using the k-nearest neighbors algorithm. Normalization is a technique that rescales the values of features to a common range, such as [0, 1] or [-1, 1]. Normalization can help reduce the influence or dominance of some features over others, as well as improve the accuracy and performance of the algorithm2.

Sampling bias occurs when a data segment is collected in such a way that some members of the intended statistical population are less likely to be included than others. This can result in a sample that is not representative of the population and may lead to inaccurate or misleading conclusions. Sampling bias can be caused by various factors, such as non-random sampling methods, non-response, self-selection, or convenience sampling. References: [Sampling bias - Wikipedia], [What is Sampling Bias? Definition, Types and Examples]

The Adversarial ML Threat Matrix is an open framework designed to help detect, respond to, and remediate threats in ML systems. The Adversarial ML Threat Matrix is inspired by the MITRE ATT&CK® Matrix1, which is a framework for describing cyberattacks across various stages of an attack lifecycle. The Adversarial ML Threat Matrix adapts this framework to address specific threats and vulnerabilities in ML systems, such as data poisoning, model stealing, model evasion, or model inversion2. The Adversarial ML Threat Matrix provides a structured way to organize and classify adversarial techniques, tactics, procedures, examples, and mitigations for ML systems2.

Generative adversarial networks (GAN) are a type of AI technology that can create fake videos, images, audio, or text that are realistic and indistinguishable from real ones. GAN consist of two neural networks: a generator and a discriminator. The generator tries to produce fake samples from random noise, while the discriminator tries to distinguish between real and fake samples. The two networks compete against each other in a game-like scenario, where the generator tries to fool the discriminator and the discriminator tries to catch the generator. Through this process, both networks improve their abilities until they reach an equilibrium where the generator can produce convincing fakes.

 Independence is an assumption of linear regression that states that the errors (residuals) of the model are independent of each other, meaning that they are not correlated or influenced by previous or subsequent errors. Independence can be violated when the data has serial correlation or autocorrelation, which means that the value of a variable at a given time depends on its previous or future values. This can happen when the data is collected over time (time series) or over space (spatial data). In this case, the data is collected over time from a group of subjects, which may introduce serial correlation among the errors.

A neural network without an activation function is equivalent to a form of a linear regression. A neural network is a computational model that consists of layers of interconnected nodes (neurons) that process inputs and produce outputs. An activation function is a function that determines the output of a neuron based on its input. An activation function can introduce non-linearity into a neural network, which allows it to model complex and non-linear relationships between inputs and outputs. Without an activation function, a neural network becomes a linear combination of inputs and weights, which is essentially a linear regression model.

Stratification is not a valid cross-validation method, but a technique to ensure that each subset of data has the same proportion of classes or labels as the original data. Stratification can be used in conjunction with cross-validation methods such as k-fold or leave-one-out to preserve the class distribution and reduce bias or variance in the validation results. Bootstrapping, k-fold, and leave-one-out are all valid cross-validation methods that use different ways of splitting and resampling the data to estimate the performance of a machine learning model.

An activation function is a function that determines the output of a neuron in a neural network based on its input. An activation function can introduce non-linearity into a neural network, which allows it to model complex and non-linear relationships between inputs and outputs. Some of the common activation functions are:

• Sigmoid: A sigmoid function is a function that maps any real value to a value between 0 and 1. It has an S-shaped curve and is often used for binary classification or probability estimation.
• Hyperbolic tangent: A hyperbolic tangent function is a function that maps any real value to a value between -1 and 1. It has a similar shape to the sigmoid function but is symmetric around the origin. It is often used for regression or classification problems.
• ReLU: A ReLU (rectified linear unit) function is a function that maps any negative value to 0 and any positive value to itself. It has a piecewise linear shape and is often used for hidden layers in deep neural networks.

Additive is not an activation function, but rather a term that describes a property of some functions. Additive functions are functions that satisfy the condition f(x+y) = f(x) + f(y) for any x and y. Additive functions are linear functions, which means they have a constant slope and do not introduce non-linearity.

Workflow design patterns for machine learning pipelines are common solutions to recurring problems in building and managing machine learning workflows. One of these patterns is to represent a pipeline with a directed acyclic graph (DAG), which is a graph that consists of nodes and edges, where each node represents a step or task in the pipeline, and each edge represents a dependency or order between the tasks. A DAG has no cycles, meaning there is no way to start at one node and return to it by following the edges. A DAG can help visualize and organize the pipeline, as well as facilitate parallel execution, fault tolerance, and reproducibility.

Emergent bias is a type of bias that arises when an AI model encounters new or different data or scenarios that were not present or accounted for during its training or development. Emergent bias can cause the model to make inaccurate or unfair predictions or decisions, as it may not be able to generalize well to new situations or adapt to changing conditions. One possible cause of emergent bias is seasonality, which means that some variables or patterns in the data may vary depending on the time of year. For example, if an AI model for merchandise sales prediction was trained in winter and applied in summer, it may produce biased results due to differences in customer behavior, demand, or preferences.

R-squared is a statistical measure that indicates how well a regression model fits the data. R-squared is calculated by dividing the explained variance by the total variance. The explained variance is the amount of variation in the dependent variable that can be attributed to the independent variables. The total variance is the amount of variation in the dependent variable that can be observed in the data. R-squared ranges from 0 to 1, where 0 means no fit and 1 means perfect fit.

A support-vector machine (SVM) is a supervised learning algorithm that can be used for classification or regression problems. An SVM tries to find an optimal hyperplane that separates the data into different categories or classes. However, sometimes the data is not linearly separable, meaning there is no straight line or plane that can separate them. In such cases, a polynomial kernel can help improve the prediction of the SVM by transforming the data into a higher-dimensional space where it becomes linearly separable. A polynomial kernel is a function that computes the similarity between two data points using a polynomial function of their features.

A false negative is an error where a positive case (belonging to the target class) is incorrectly predicted as negative (not belonging to the target class). A false negative rate is the ratio of false negatives to all actual positive cases. A low false negative rate means that most of the positive cases are correctly identified by the classifier.

For a diagnostic tool that can diagnose a particular disease so that individuals with the disease can receive treatment, it is of primary importance that it has a low false negative rate. This is because false negatives can have serious consequences for patients who have the disease but do not receive treatment, such as increased risk of mortality or complications. A low false negative rate can ensure that most patients who have the disease are diagnosed correctly and receive timely treatment.

Precision is a measure of how well a classifier can avoid false positives (incorrectly predicted positive cases). Precision is calculated by dividing the number of true positives (correctly predicted positive cases) by the number of predicted positive cases (true positives and false positives). In this confusion matrix, the true positives are 37 and the false positives are 8, so the precision is 37/(37+8) = 0.822.

The General Data Protection Regulation (GDPR) is a privacy-focused law that an AI practitioner should adhere to while designing and adapting an AI system that utilizes personal data. The GDPR applies to any organization that processes personal data of individuals in the European Union (EU), regardless of where the organization is located. The GDPR grants individuals rights over their personal data, such as the right to access, rectify, erase, restrict, or object to its processing. The GDPR also imposes obligations on organizations that process personal data, such as the duty to obtain consent, conduct data protection impact assessments, implement data protection by design and by default, and ensure accountability and transparency. The GDPR also addresses some specific issues related to AI, such as automated decision-making, profiling, and data portability.

Logit-transformation is a common way to transform proportion data into a continuous variable that can be used for linear regression. However, one concern with this approach is that noisy data could become more influential in your model. This is because logit-transformation tends to amplify the values close to 0 and 1, which are also the values that are likely to be affected by measurement errors or outliers. This could distort the relationship between the dependent and independent variables and bias the regression coefficients. References: [Logit Transformation | Real Statistics Using Excel], [Logit transformation for proportions - Cross Validated]

Unsupervised learning is a type of machine learning that involves finding patterns or structures in unlabeled data without any predefined outcome or feedback. Unsupervised learning can be used for various tasks, such as clustering, dimensionality reduction, anomaly detection, or association rule mining. Some of the common algorithms for unsupervised learning are:

• Principal components analysis: Principal components analysis (PCA) is a method that reduces the dimensionality of data by transforming it into a new set of orthogonal variables (principal components) that capture the maximum amount of variance in the data. PCA can help simplify and visualize high-dimensional data, as well as remove noise or redundancy from the data.
• K-means clustering: K-means clustering is a method that partitions data into k groups (clusters) based on their similarity or distance. K-means clustering can help discover natural or hidden groups in the data, as well as identify outliers or anomalies in the data.
• Apriori algorithm: Apriori algorithm is a method that finds frequent itemsets (sets of items that occur together frequently) and association rules (rules that describe how items are related or correlated) in transactional data. Apriori algorithm can help discover patterns or insights in the data, such as customer behavior, preferences, or recommendations.

Harms modeling is a technique that helps product managers design AI solutions responsibly by evaluating both positive and negative outcomes. Harms modeling involves creating a shared taxonomy of potential negative impacts and conducting an assessment along vectors such as severity, impact, frequency, and likelihood. Harms modeling can help identify and mitigate any risks or harms that may arise from using AI solutions. References: [Harms Modeling for Responsible AI | by Google Developers | Google Developers], [Harms Modeling for Responsible AI - YouTube]

The final stage of the data management life cycle is data destruction, which is the process of securely deleting or erasing data that is no longer needed or relevant for the organization. Data destruction ensures that data is disposed of in compliance with any legal or regulatory requirements, as well as any internal policies or standards. Data destruction also protects the organization from potential data breaches, leaks, or thefts that could compromise its privacy and security. Data destruction can be performed using various methods, such as overwriting, degaussing, shredding, or incinerating

k-means clustering is an algorithm that should be used by the market research team to obtain groups of patients with similar unmet needs. k-means clustering is an unsupervised learning technique that partitions the data into k clusters based on the similarity of the features. The algorithm iteratively assigns each data point to the cluster with the nearest centroid and updates the centroid until convergence. k-means clustering can help identify patterns and segments in the data that may not be obvious or intuitive. References: [K-means clustering - Wikipedia], [How to Run K-Means Clustering in Python]

Cloud models are service models that provide different levels of abstraction and control over computing resources in a cloud environment. Some of the common cloud models for machine learning pipelines are:

• Software as a Service (SaaS): SaaS provides ready-to-use applications that run on the cloud provider’s infrastructure and are accessible through a web browser or an API. SaaS can provide AI practitioner data science services such as Jupyter notebooks, which are web-based interactive environments that allow users to create and share documents that contain code, text, visualizations, and more.
• Platform as a Service (PaaS): PaaS provides a platform that allows users to develop, run, and manage applications without worrying about the underlying infrastructure. PaaS can provide some services within an application such as payment applications to create efficient results.
• Infrastructure as a Service (IaaS): IaaS provides access to fundamental computing resources such as servers, storage, networks, and operating systems. IaaS can provide CPU, memory, disk, network and GPU resources that can be used to run machine learning models and applications.
• Data as a Service (DaaS): DaaS provides access to data sources that can be consumed by applications or users on demand. DaaS can host the databases providing backups, clustering, and high availability.