BiSP Logo

Biometric Smart Pen Project

The BiSP System

The Biometric Smart Pen (BiSP) is a novel multisensoric pen system for the record and analysis of handwriting,drawing and gesture movements on a paper pad or free in space. For a comprehensive monitoring of fine motor characteristics of the hand and fingers, the ball pen like device is equipped with a diversity of sensors measuring:

  • position, acceleration and tilt angle of the pen in space
  • pressure and vibration generated in the refill during writing or drawing on a pad
  • grip pressure of fingers holding the pen

Different to common tablet-based input devices, the data are sampled exclusively by the pen. The pen transfers digital data to mobile units like PC, notebook, cell phone, smart card, memory, etc. either by wired or wireless transmission technology. A universal software classifier implemented in the smart pen system covers a broad range of time-series analysis, statistics, feature extraction and classification. It provides important object-related parameters as well as biometric and neuromotor features of a human being ("Talking Hands").

Bild zu BiSP-System

Biometrics

Person authentication based on biometric traits in handwriting is a compelling alternative for techniques using static biological features, e.g. iris scan, fingerprint or face recognition. Although, like any biometric pattern, the biometrics of handwriting is inherently prone to considerable statistical variability, there is a high potential for scientific and commercial applications due to the extensive information embedded in the kinematics and dynamics of handwritten signatures, figures or text.
Our BiSP becomes in combination with a newly developed software for signal processing, feature extraction, data compression, database management and fast matching algorithms, an innovative system for widespread use in biometric person verification and identification applications.
An innovative application seen for our BiSP device is the biometrical protection of the USB memory stick. The pen based technique is a compelling alternative for fingerprint to secure an USB stick. We expect a major market due to the booming USB memory stick, the increasing demand of its data security, the high user acceptance as for writing and the enorrmous popularity of widely used ball pens.

Applications

  • Access control or security in business-, legal-, and private sectors for territories, devices and services.
  • Generation and storage of biometric data from trained behavioral and congenital physical features.
  • Input of digital biometric signature, PSW, PIN for e-commerce, e-documentation and e-datamanagement.
  • Biometric personalization in rooms, devices and services.
  • Biometric data encryption.

Relevant Innovations

  • Data security of USB memory sticks.
  • Desktop personalization of working environment and feasibilities.
  • Two-factor authentication based on both PIN/PSW and writer recognition.
Bild zu BiSP-System

Health Care

Fine motor movements of the hand and fingers are an important indicator for neuromotor disorders generated by illness, medication, drug consumption and stress, etc.
Our biometric smart pen, BiSP, is an excellent platform for the development of standard methods of computer aided diagnostics and therapy in pharmacology, health care institutions and home care. Particularly, the pen is an ideal tool for the classification and quantification of neuromotor disorders and fine motor deficiencies.

Applications

  • Computer aided diagnosis and therapy of neurological diseases and of fine-motor dysfunctions due to Parkinson, schizophrenia, apoplexia, Multiple Sclerosis, etc.
  • Symptom assessment and therapy in psychology and education e.g. ADHS, handwriting disability and dystonia graphonomics.
  • Remote and mobile control of humans under drug treatment, physical or mental stress and legal drugs like alcohol (fine motor coordination and psychomotor performance).
  • Investigation of capacity of reaction and attentiveness.
  • Biometric feedback (visual and audible) for rehabilitation.
  • Phenotyping of patients for ePatient record.

Relevant Innovations

  • Non-invasive device for objective low cost medication control and patient monitoring in home care and telemedicine.
  • BiSP in combination with graphic tablets and display units.
Bild zu BiSP-System

Computer Input

Another promising application area is the digital pen based input of handwritten characters and notes as well as drawings, gestures and cursor movements into small mobile devices such as PDAs, cell phones and notebooks.

Our BiSP has emerged as a successful device for cursor control and handwritten character recognition. It also was found that the input device works equally well for writing on paper pad or in free space.

Applications

Prospectively our pen based input device BiSP can be properly used for:

  • the SMS input of cell phones,
  • as a pen based computer mouse with extras such as the input of text, graphics and biometric data for login.

Relevant Innovations

  • Input device for gestures recognition in free space (virtual reality).
  • BiSP data for simulation and controlling of hand prostheses or an anthropomorphic robotic hand.
Bild zu BiSP-System

Contact

University of Applied Sciences Regensburg

BiSP Center Regensburg Seybothstr. 2 D-93053 Regensburg, Germany Tel: ++49-941 943 1155 Fax:++49-941 943 1424 www.bisp-regensburg.de Prof. Dr. Roland Mandl e-mail: roland.mandl(at)oth-regensburg.de Gerald Schickhubere-mail: gerald.schickhuber(at)oth-regensburg.de

Bild zu BiSP-System

References

Publications

  • Muzaffar Bashir, Georg Scharfenberg and Juergen Kempf, "Person Authentication by Handwriting in air using a Biometric Smart Pen Device", CAST-Workshop, BIOSIG2011 Biometrics and Security, Sept., 08-09, 2011, Darmstadt, Germany
  • Peuker, D., Scharfenberg, G., Hook, ch., "Feature Selection for the Detection of Fine Motor Movement Disorders in Parkinson’s Patients", Advanced Research Conference 2011, ARC 2011, Shaker Verlag, ISBN 978-3-8322-9954-5
  • Bashir, M., Kempf, F., "Advanced Biometric Pen System for Recording and Analyzing Handwriting". In Journal of Signal Processing Systems, Springer, 2011. *DOI 10.1007/s11265-011-0576-z
  • Bashir, M., Kempf, J., "DTW based Classification of Diverse Pre-processed Time Series obtained from Handwritten PIN words and Singatures". In Journal of Signal Processing Systems, Springer New York, 2010
  • M. Bashir, J. Kempf, G. Schickhuber, G. Scharfenberg, "Online Person Authentication Using Dynamic Signature on a Novel Tactile and Pressure Sensitive Pad" in November 24-26, Telfor, 2009, Belgrade, Serbia
  • Bashir and Jürgen Kempf, "Bio-Inspired Reference Level Assignged DTW for Person Identification using Handwritten Signatures", BioID_MultiComm2009, Madrid, Spain, LNCS 5707,pp. 200-206, 2009, Springer-Verlag Berlin Heidelberg 2009
  • Bashir, and J. Kempf, "Person authentication with RDTW based on handwritten PIN and signature with a novel biometric smart pen device",
    IEEE Workshop on Computational Intelligence in Biometrics: Theory, Algorithms, and Applications, 2009. CIB 2009, Volume , Issue , March 30 2009-April 2 2009 Page(s):63 - 68
  • Bashir, and J. Kempf, "Reduced Dynamic Time Warping for Handwriting Recognition Based on Multidimensional Time Series of a Novel Pen Device", WASET, International Journal of Intelligent Systems and Technologies, Volume 3 Number 4, Art. 31, p.194, Fall 2008
  • Bashir, and J. Kempf, "Reduced Dynamic Time Warping for Handwriting Recognition Based on Multidimensional Time Series of a Novel Pen Device", WASET, Paris 2008
  • Bashir, and J. Kempf, "Reduced Dynamic Time Warping for Handwriting Recognition Based on Multidimensional Time Series of a Novel Pen Device", WASET, Porceedings, Vol. 35 Nov. 2008 ISSN 2070-3740
  • N., Hangai, S., Scharfenberg, G., Kempf, J., Hook, C. "Extraction of Target Areas based on Turning Points for Signature Verification", A Study on Signature/Sign Processed Dynamic Data Format SC37 N2442, Tech. Rep. of Biometrics Security Group (June 2008)
  • "Ein intelligenter digitaler Schreibstift BiSP® für Computereingabe Biometrie und Medizin." Kolloquium Mikrosystemtechnik – Sensorik, Hochschule Regensburg, 2008, Germany
  • "A Smart Digital Multisensor Pen BiSP® for Applications in Medicine, Biometrics and for Computer Input" UNESP (Bauru, São Paulo) 2008; Brasil
  • "BioSensing of hand and finger movement", Kolloquium Biophysik, University Regensburg, 2008, Germany
  • J.Kempf, G. Scharfenberg, G. Schickhuber: "Intelligentes multisensorielles Schreibsystem BiSP",Elektronik-Zeitschrift 2008
  • T., Hangai, S., Kempf, J., Hook, C., Scharfenberg: "PIN Identification for Japanese using a Biometrical Smart Pen", SCIS2007, 4F2-3 (2007), Nagasaki, Japan
  • Dose, C. Gruber, A. Grunz, C. Hook, J. Kempf, G. Scharfenberg, B. Sick: "Towards an Automated Analysis of Neuroleptics Impact on Human Hand Motor Skills", IEEE 2007
  • "BiSP ein intelligenter multisensorieller Schreibstift für Computereingabe, Biometrie und Medizin"Informatik Akademie (IBM), Bildungszentrum S-Degerloch, 2007
  • T., Hangai, S., Kempf, J., Hook, C., Scharfenberg, G.: "An Identification of Japanese Numerical Characters on a Biometrical Smart Pen System", 1-4244-1300-1/2007 @ 2007 IEEE, p.232-237
  • V. Palla, G. Scharfenberg, J. Kempf, G. Schickhuber: "Wireless Communication using ZigBee R technology for Medical Purpose in the BiSP-System" Spektrum Hochschule Regensburg 2007
  • Gruber, C., Hook, C., Kempf J., Scharfenberg, G., Sick, B."A Flexible Architecture for Online Signature Verification Based on a Novel Biometric Pen", Adaptive and Learning Systems, 2006 IEEE Mountain Workshop on, 1-4244-0166-6/06, p 110-115, 2006
  • "BiSP Tutorials", Tokyo University of Science, Tokyo 2006, Japan
  • "Science on the Street", Pilsen 2006, Czech Republic
  • "QISP – Der biometrische Feldversuch an der FH Regensburg", IT Security Forum 2006, Germany
  • "BiSP für Biometrie, Gesundheitswesen und Computereingabe",Summer School Sensoric Regensburg 2006, Regensburg, Germany
  • "BiSP für Biometrie, Gesundheitswesen und Computereingabe", Businessplan-Wettbewerb 2006, Coburg und Nürnberg, Germany
  • "Biometric Smart Pen - BiSP", Hofer Informatiktage 2006, Hof, Germany
  • "Drahtlose Sensorik am Beispiel BiSP", IAFW-Tagung 2006, Germany
  • "BiSP - The Talking Hand System“ 2006; SSA-Symposium-DanuBiobank, Budapest 2006, Hungary
  • Kempf J., Hook C., Scharfenberg, G. "Biometrischer Stift", Deutsches Ärzteblatt Praxis 3/2005, #102, Ausgabe 20, 20.05.2005
  • Hook C. "BiSP team launches collaboration with Tokyo University of Science", Spektrum der Fachhochschule Regensburg 02/2005
  • Kempf J., Hook C., Scharfenberg, G. "Biometrischer Stift", Deutsches Ärzteblatt Praxis 3/2005, #102, Ausgabe 20, 20.05.2005
  • "Das BiSP Projekt", IT Security Forum 2005, FH Regensburg
  • "BiSP Tutorials", Tokyo University of Science, Tokyo 2005, Japan
  • "Biometrie, Handschrift: Prototypen", IT Talk Cebit 2005, Hannover, Germany
  • Hook C., Kempf J., Scharfenberg, G."Assessment of fine motor characteristics of handwriting movements using a multichannel digitizing smart pen" gmds2004, Innsbruck 2004
  • Hook C.,Kempf J., Scharfenberg, G. "A Novel Digitizing Pen for the Analysis of Pen Pressure and Inclination in Handwriting Biometrics" , Biometric Authentication Workshop, Prague 2004, Lecture Notice in Computer Science. Springer 2004
  • "BiSP for Person Authentification", Biometric Authentication Workshop, Prague 2004, Tschechien
  • "BiSP für Anwendungen in der Biometrie und Neurologie", Das Jahr der Technik - "Technik pur" 2004, FH Regensburg, Germany
  • "BiSP Projekt", Arbeitskeis Sensorik Infineon 2004, Regensburg, Germany
  • "BiSP für Anwendungen in der Biometrie und Neurologie", IAFW Taging 2004, Amberg, Germany
  • "Biometrical and Medical Smart Pen", Strategische Partnerschaft Sensorik, Biopark, Regensburg 2004, Germany
  • Hook C., Kempf J., Scharfenberg, G. "New Pen Device for Biometrical 3D Pressure Analysis of Handwritten Characters, Words and Signatures", Proceedings: ACM Multimedia 2003, Berkeley, USA
  • Hook C., Kempf J., Scharfenberg G. " Biometrical Smart Pen BiSP for Personal Identification, Online Handwriting and Speech Recognition, Proceedings: 48.Int. Wissenschaftliches Kolloquium, Ilmenau 2003
  • Hook C., Kempf J., Scharfenberg G. " Biometrical Smart Pen BiSP for Personal Identification, Online Handwriting and Speech Recognition, Proceedings: 48.Int. Wissenschaftliches Kolloquium, Ilmenau 2003
  • Soule M., Kempf J., Handwritten Text Analysis through Sound, Proceedings: IWSSIP03, Praha
  • Hook C., Kempf J., Scharfenberg G., Tagungsband: Mathematische Analyse biometrischer Signaturen, IAFW 2003-Tagung
  • "New Pen Device for Biometrical 3D Pressure Analysis of Handwritten Characters, Words and Signatures", ACM Multimedia 2003, Berkeley, USA
  • "Biometrical Smart Pen BiSP for Personal Identification, Online Handwriting and Speech Recognition , 48.Int. Wissenschaftliches Kolloquium, Ilmenau 2003
  • "Entwicklung eines "multifunktionalen, biometrischen Schreibsystems BiSP zur Personenidentifikation, Handschriften- und Spracherkennung" Universität Freiburg, 2003
  • Mautner P., Rohlík O., Matoušek V., Kempf J.: Signature Verification Using an ART-2 Neural Network. In: Proceedings of the Int. Conf. ICONIP '02, Singapore, November 2002
  • Mautner P., Rohlík O., Matoušek V., Kempf J.: Fast Signature Verification without a Special Tablet. In: Proceedings of the Int. Conf. IWSSIP '02, Manchester, November 2002
  • "Biometrical Smart Pen BiSP-Projekt" bei der Firma Schmidt Feintechnik GmbH, St. Georgien/Schwarzwald und im IMIT-Institut (Villingen-Schwenningen)
  • "Biometrisches Schreibsystem zur elektronischen Authentifizierung, Sprach- und Handschriftenerkennung" Bayern Innivativ/Bay Tech Forum 2002-Ingolstadt
  • "Entwicklung eines optischen Multisensorstiftes zur Online-Handschriftenerkennung". Anlässlich der Verleihung des Josef-Stanglmeier- und Innovationspreises 2002
  • Rohlík O., Mautner P., Matoušek V., Kempf J., Weinzierl K.: Digital Data Acquisition Pen for Signature Verification. In: Neural Network World, Int. Journal on Non-Standard Computing and Artificial Intelligence, Vol. 11, No. 5, October 2001, pp. 493 - 501
  • Rohlík O., Mautner P., Matoušek V., Kempf J., Weinzierl K.: A New Approach to Signature Verification: Digital Data Acquisition Pen. In: Proceedings of the International Conference SoftCom 2001, FESB Split, October 2001, Vol. II, pp. 879 - 885

Patents

  • Patent issued: "Biometrisches, akustisches Schreibsystem sowie Verfahren und Verwendung hierzu", DPA Nr. 10241328; Anmeldetag: 04.09.2002; Inventor: J.Kempf
  • Patent issued: "Fluidisches Peripherie-Eingabegerät für eine elektronische Datenverarbeitungsvorrichtung", DPA Nr. 10 2005 017 936.3-53; Anmeldetag: 18.04.2005; Inventor: C. Hook, J.Kempf
  • Utiltity Patent: "Schreibvorrichtung zum gesicherten Speichern von Anwendungsdaten". DPA-Nr. 20 2007 002 778.8; Anmeldetag: Anmelder: Hook, Kempf

Trademarks

  • Peripen (2005), Pentrics (2005), BiSP (2008)

Awards

  • Nomination of AMA Innovationspreis Sensorik 2008
  • Fresenius Erfinderpreis, 1.Platz 2006
  • Businessplan-Wettbewerb Nordbayern (Gewinner) 2006
  • Wissenschaftspreis der Edmund Bradatschstiftung 2004
  • Innovationspreis der Stangelmayerstiftung 2002
  • Wissenschaftspreis der Edmund Bradatschstiftung 2002
  • EON-Kulturpreis 2002