Question:
Consider a two-class problem in \( \mathbb{R}^d \) with class labels red and green. Let \( \mu_{\text{red}} \) and \( \mu_{\text{green}} \) be the means of the two classes. Given test sample \( x \in \mathbb{R}^d \), a classifier calculates the squared Euclidean distance (denoted by \( \| \cdot \|^2 \)) between \( x \) and the means of the two classes and assigns the class label that the sample \( x \) is closest to. That is, the classifier computes
\[
f(x) = \| \mu_{\text{red}} - x \|^2 - \| \mu_{\text{green}} - x \|^2
\]
and assigns the label red to \( x \) if \( f(x)<0 \), and green otherwise. Which of the following statements is/are correct?
Consider a two-class problem in \( \mathbb{R}^d \) with class labels red and green. Let \( \mu_{\text{red}} \) and \( \mu_{\text{green}} \) be the means of the two classes. Given test sample \( x \in \mathbb{R}^d \), a classifier calculates the squared Euclidean distance (denoted by \( \| \cdot \|^2 \)) between \( x \) and the means of the two classes and assigns the class label that the sample \( x \) is closest to. That is, the classifier computes
\[
f(x) = \| \mu_{\text{red}} - x \|^2 - \| \mu_{\text{green}} - x \|^2
\]
and assigns the label red to \( x \) if \( f(x)<0 \), and green otherwise. Which of the following statements is/are correct?
Show Hint
The function \( f(x) = \|\mu_{\text{red}} - x\|^2 - \|\mu_{\text{green}} - x\|^2 \) is linear in \( x \) because it involves the difference of linear terms with respect to \( x \).
Updated On: Feb 3, 2026
- The sample \( x = 0 \) is assigned the label green if \( \| \mu_{\text{red}} \| \| \mu_{\text{green}} \| \)
- \( f \) is a linear function of \( x \)
- \( f(x) = w^T x + b \), where \( w \) and \( b \) are functions of \( \mu_{\text{red}} \) and \( \mu_{\text{green}} \)
- \( f \) is quadratic polynomial in \( x \)
Show Solution
Verified By Collegedunia
The Correct Option is B, C
Solution and Explanation
We are given that the classifier computes the squared Euclidean distance between \( x \) and the means of two classes, and we can expand the function \( f(x) \) as:
\[
f(x) = \|\mu_{\text{red}} - x\|^2 - \|\mu_{\text{green}} - x\|^2
\]
Expanding both terms:
\[
f(x) = (\mu_{\text{red}}^T \mu_{\text{red}} - 2 \mu_{\text{red}}^T x + x^T x) - (\mu_{\text{green}}^T \mu_{\text{green}} - 2 \mu_{\text{green}}^T x + x^T x)
\]
Simplifying:
\[
f(x) = (\mu_{\text{red}}^T \mu_{\text{red}} - \mu_{\text{green}}^T \mu_{\text{green}}) + 2 (\mu_{\text{green}}^T - \mu_{\text{red}}^T) x
\]
This shows that \( f(x) \) is a linear function of \( x \), so Option (B) is correct.
Also, \( f(x) \) can be written as \( f(x) = w^T x + b \), where \( w = 2(\mu_{\text{green}} - \mu_{\text{red}}) \) and \( b = \mu_{\text{red}}^T \mu_{\text{red}} - \mu_{\text{green}}^T \mu_{\text{green}} \), so Option (C) is also correct.
Was this answer helpful?
0
0
Top GATE DA Data Science and Artificial Intelligence Questions
- Consider performing depth-first search (DFS) on an undirected and unweighted graph G starting at vertex s. For any vertex u in G, d[u] is the length of the shortest path from s to u. Let (u, v) be an edge in G such that d[u] < d[v]. If the edge (u, v) is explored first in the direction from u to v during the above DFS, then (u, v) becomes a _____ edge.
- Three fair coins are tossed independently. T is the event that two or more tosses result in heads. S is the event that two or more tosses result in tails. What is the probability of the event T ∩ S?
- Consider the matrix \(M=\begin{bmatrix} 2 & -1 \\ 3 & 1 \end{bmatrix}\).
Which ONE of the following statements is TRUE ? - For any twice differentiable function ƒ: R → R, if at some x* ∈ R, f'(x*) = 0 and f'(x*) > 0, then the function f necessarily has a ______ at x = x*.
Note : R denotes the set of real numbers. - Match the items in Column 1 with the items in Column 2 in the following table :
Column 1 Column 2 (p) First In First Out (i) Stacks (q) Lookup Operation (ii) Queues (r) Last In First Out (iii) Hash Tables
View More Questions
Top GATE DA Machine Learning Questions
- Let 4 points in 3D: P1 = [2,3,4,], P2 = [3,1,1], P3 = [5, -2, 3] ,P4 = [3,3,3]. Hierarchical Agglomerative clustering is used to cluster the above points. If Manhattan Distance is used as the distance metric during clustering, which two points will be merged first?
- For a classification problem PCA has been used to reduce the dimensionality of a feature space from 100 to 10. Which of the following option is true about the angle b/w first 2 and 10th principal components?
- Consider the supervised learning task. The objective function being minimized is \( f(w) = w \cdot x \), where \( w \in \mathbb{R} \) is the parameter. Stochastic Gradient Descent with learning rate of 0.10. Let \( w = 10.00 \) be the \( i^{\text{th}} \) iteration (\( w_i \)). The value of \( w \) at the end of iteration \( (i+1) \) is if \( x = 10 \) ________. Round off 2 decimal.
- Consider that you are training a classifier for a 10-class classification problem. Each I/P is represented as a 512 dimensional vector. There are 1000 samples out of which first 100 will be used for testing. Let Leave-one-out-Cross-Validation (LOOCV) be used for selection of the classifier model before testing. Which of the following option is the correct option for no. of validation split that will be generated?
- Consider the Ridge LRR is being used to learn prediction function \( y_{\text{pred}} = w^T x \) where \( w, x \in \mathbb{R}^2 \) & mean absolute error (MAE) is used to measure the prediction error. A weight of 0.20 is associated with the regularizer. At an intermediate step of training process assume that the parameter \( w = [-3.00, 4.00]^T \). In the next step for the I/P \( x = [1.00, 2.00]^T \), the predicted value of \( y \) is noted. Let the relation b/w \( x = [x_1, x_2]^T \) & the true value of \( y \) be \( y_{\text{true}} = x_1 + x_2 \). The value of the overall regularized loss for instance is __________ (upto 2 decimal).
View More Questions
Top GATE DA Questions
- Consider performing depth-first search (DFS) on an undirected and unweighted graph G starting at vertex s. For any vertex u in G, d[u] is the length of the shortest path from s to u. Let (u, v) be an edge in G such that d[u] < d[v]. If the edge (u, v) is explored first in the direction from u to v during the above DFS, then (u, v) becomes a _____ edge.
- Three fair coins are tossed independently. T is the event that two or more tosses result in heads. S is the event that two or more tosses result in tails. What is the probability of the event T ∩ S?
- Consider the matrix \(M=\begin{bmatrix} 2 & -1 \\ 3 & 1 \end{bmatrix}\).
Which ONE of the following statements is TRUE ? - For any twice differentiable function ƒ: R → R, if at some x* ∈ R, f'(x*) = 0 and f'(x*) > 0, then the function f necessarily has a ______ at x = x*.
Note : R denotes the set of real numbers. - Match the items in Column 1 with the items in Column 2 in the following table :
Column 1 Column 2 (p) First In First Out (i) Stacks (q) Lookup Operation (ii) Queues (r) Last In First Out (iii) Hash Tables
View More Questions