Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Numpy- get neighbors matrix from 2D array

I have a undirected graph given by:

A,B
A,C
A,F
B,D
C,D
C,F
E,D
E,F

And I need to transform this to a matrix N where

N[x,y] = 1 if x is neighbor of y (like A and B) and 0 if not

What is the fastest way to do it?

NOTA The graph is stored as numpy array of strings:

array([['A', 'B'],
       ['A', 'C'],
       ['A', 'F'],
       ['B', 'D'],
       ['C', 'D'],
       ['C', 'F'],
       ['E', 'D'],
       ['E', 'F']], 
      dtype='|S4')

Expected output:

   A B C D E F
A  1 1 1 0 0 1
B  1 1 0 1 0 0 
C  1 0 1 1 0 1
D  0 1 1 1 1 0
E  0 0 0 1 1 1 
F  1 0 1 0 1 1

Thanks

like image 285
farhawa Avatar asked Jan 08 '23 04:01

farhawa


1 Answers

Here's one NumPythonic approach -

# Tag each string with a numeric ID based on the uniqueness among other strings
_,ID = np.unique(graph,return_inverse=True)
M = ID.reshape(graph.shape)

# Consider each row of numeric IDs as an indexing tuple of a 2D array.
# Calculate the linear indices corresponding to each tuple.
n = M.max()+1
idx1 = M[:,0]*(n) + M[:,1]
idx2 = M[:,1]*(n) + M[:,0]

# Setup output array with 1s on the diagonal.
out = np.eye(n,dtype=int)

# Put 1s at places specified by the earlier computed pairs of linear indices
np.put(out,[idx1,idx2],1)

Sample input, output -

In [93]: graph
Out[93]: 
array([['A', 'B'],
       ['A', 'C'],
       ['A', 'F'],
       ['B', 'D'],
       ['C', 'D'],
       ['C', 'F'],
       ['E', 'D'],
       ['E', 'F']], 
      dtype='|S4')

In [94]: out
Out[94]: 
array([[1, 1, 1, 0, 0, 1],
       [1, 1, 0, 1, 0, 0],
       [1, 0, 1, 1, 0, 1],
       [0, 1, 1, 1, 1, 0],
       [0, 0, 0, 1, 1, 1],
       [1, 0, 1, 0, 1, 1]])

Runtime tests

This section basically compares all the approaches (in this post and other posts) listed thus far on performance to solve the case.

Define functions -

def networkx_based(a): #@atomh33ls's solution code
    A=nx.Graph()
    for x in a:
        A.add_edge(x[0],x[1])
    return nx.adjacency_matrix(A)

def vectorize_based(data): # @plonser's solution code
    ord_u = np.vectorize(lambda x: ord(x)-65)
    s = ord_u(data)
    res = np.zeros((s.max()+1,s.max()+1),dtype=int)
    res[s[:,0],s[:,1]] = 1
    res_sym = res + res.T
    np.fill_diagonal(res_sym,1)
    return res_sym

def unique_based(graph): #solution from this post
    _,ID = np.unique(graph,return_inverse=True)
    M = ID.reshape(graph.shape)
    n = M.max()+1
    idx1 = M[:,0]*(n) + M[:,1]
    idx2 = M[:,1]*(n) + M[:,0]
    out = np.eye(n,dtype=int)
    np.put(out,[idx1,idx2],1)
    return out

Timings -

In [321]: N = 1000

In [322]: arr = np.random.randint(65,90,(N,2))

In [323]: graph = np.array([map(chr,a) for a in arr],dtype='S4')

In [324]: %timeit networkx_based(graph)
100 loops, best of 3: 3.79 ms per loop

In [325]: %timeit vectorize_based(graph)
1000 loops, best of 3: 760 µs per loop

In [326]: %timeit unique_based(graph)
1000 loops, best of 3: 405 µs per loop
like image 131
Divakar Avatar answered Jan 16 '23 09:01

Divakar