Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
D
db_gpt
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
linyangyang
db_gpt
Commits
5331e365
Commit
5331e365
authored
Oct 12, 2024
by
于飞
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
修改关键词匹配规则,使用近义词过滤
parent
bb47c76f
Changes
3
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
97 additions
and
43 deletions
+97
-43
filter.py
dbgpt/app/apps/utils/filter.py
+0
-1
keywordsviews.py
dbgpt/app/apps/vadmin/keywordsviews.py
+89
-42
crud.py
dbgpt/app/apps/vadmin/word/crud.py
+8
-0
No files found.
dbgpt/app/apps/utils/filter.py
View file @
5331e365
...
...
@@ -123,7 +123,6 @@ class DFAFilter():
for
keyword
in
datas
:
self
.
add
(
keyword
.
word_name
)
#最长匹配模式,确保敏感词过滤器优先匹配和替换较长的敏感词
def
filter
(
self
,
message
,
repl
=
"*"
):
is_sensitive
=
False
...
...
dbgpt/app/apps/vadmin/keywordsviews.py
View file @
5331e365
This diff is collapsed.
Click to expand it.
dbgpt/app/apps/vadmin/word/crud.py
View file @
5331e365
...
...
@@ -60,6 +60,14 @@ class SimilarDal(DalBase):
else
:
print
(
f
"编号:{similar1.id} 词条:{similar1.word_name} 近义词:{similar1.similar_name} "
)
async
def
get_similar_by_keyword
(
self
)
->
list
:
"""
根据关键词查询, 所有同义词 | 按照中文逗号分割 | 如果数据库里有英文逗号,先转换为中文逗号
"""
similar_datas
=
await
self
.
get_datas
(
limit
=
0
)
result
=
[
item
[
'similar_name'
]
.
replace
(
','
,
','
)
.
split
(
','
)
for
item
in
similar_datas
]
return
result
async
def
update_similars
(
self
,
ids
:
[],
data
:
SimilarUpdate
):
await
self
.
db
.
execute
(
update
(
self
.
model
)
.
where
(
self
.
model
.
id
.
in_
(
ids
))
.
values
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment