Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
168 views
in Technique[技术] by (71.8m points)

python - How to make clusters of Pandas data frame?

I am trying to make a cluster of the following pandas data frame and trying to give the names. E.g - "Personal Info" is cluster name and it consist of (PERSON,LOCATION,PHONE_NUMBER,EMAIL_ADDRESS,PASSPORT,SSN, DRIVER_LICENSE) and also addition of there Counts. which will be 460.

Clusters:
for reference I am providing clusters structure

Input data:

Names              Counts

CREDIT_CARD        10
CRYPTO             20
DATE_TIME          28
DOMAIN_NAME        40
EMAIL_ADDRESS      45
IBAN_CODE          20
IP_ADDRESS         100
NRP                38
LOCATION           36
PERSON             90
PHONE_NUMBER       105
BANK_NUMBER        29
DRIVER_LICENSE     45
ITIN               38
PASSPORT           49
SSN                90
NHS                0

Output:

Cluster names         Total count

Personal Info        (90+36+105+45+49+90) = 460
Finance              (10+29+38+20) = 97  
Network              (100+40) = 140
Others               (20+28) = 48
Info                 (0) = 0

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Reply

0 votes
by (71.8m points)

You can create an inverse dictionary and map:

d = {'personal_info': ['PERSON','LOCATION','PHONE_NUMBER','EMAIL_ADDRESS','PASSPORT','SSN','DRIVER_LICENSE'],
    'finance':['CREDIT_CARD','BANK_NUMBER','ITIN','IBAN_CODE'],
    'info': ['NHS'],
    'network':['IP_ADDRESS','DOMAIN_NAME'],
    'others':['CRYPTO','DATE_TIME','NRP']
    }

d_inv = {x:k for k, v in d.items() for x in v}

(df['Counts'].groupby(df['PII'].map(d_inv)).sum()
   .rename_axis('Cluster names')       # rename to match output
   .reset_index(name='Total count')
)

Output:

   Cluster names  Total count
0        finance           97
1           info            0
2        network          140
3         others           86
4  personal_info          460

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
OGeek|极客中国-欢迎来到极客的世界,一个免费开放的程序员编程交流平台!开放,进步,分享!让技术改变生活,让极客改变未来! Welcome to OGeek Q&A Community for programmer and developer-Open, Learning and Share
Click Here to Ask a Question

...