Lexical analyzer with regex. It will have regular expression to generate the tokens
File list:
lab03sc
......\lab03sc
......\.......\bin
......\.......\...\Debug
......\.......\...\.....\Database1.mdf
......\.......\...\.....\Database1_log.ldf
......\.......\...\.....\lab03sc.exe
......\.......\...\.....\lab03sc.exe.config
......\.......\...\.....\lab03sc.pdb
......\.......\...\.....\lab03sc.vshost.exe
......\.......\...\.....\lab03sc.vshost.exe.config
......\.......\...\.....\tokens.txt
......\.......\obj
......\.......\...\x86
......\.......\...\...\Debug
......\.......\...\...\.....\TempPE
......\.......\...\...\.....\......\DataSet1.Designer.cs.dll
......\.......\...\...\.....\DesignTimeResolveAssemblyReferences.cache
......\.......\...\...\.....\DesignTimeResolveAssemblyReferencesInput.cache
......\.......\...\...\.....\GenerateResource.read.1.tlog
......\.......\...\...\.....\GenerateResource.write.1.tlog
......\.......\...\...\.....\lab03sc.csproj.FileListAbsolute.txt
......\.......\...\...\.....\lab03sc.exe
......\.......\...\...\.....\lab03sc.Form1.resources
......\.......\...\...\.....\lab03sc.Form2.resources
......\.......\...\...\.....\lab03sc.pdb
......\.......\...\...\.....\lab03sc.Properties.Resources.resources
......\.......\Properties
......\.......\..........\AssemblyInfo.cs
......\.......\..........\Resources.Designer.cs
......\.......\..........\Resources.resx
......\.......\..........\Settings.Designer.cs
......\.......\..........\Settings.settings
......\.......\app.config
......\.......\Database1.mdf
......\.......\Database1_log.LDF
......\.......\DataSet1.Designer.cs
......\.......\DataSet1.xsc
......\.......\DataSet1.xsd
......\.......\DataSet1.xss
......\.......\Form1.cs
......\.......\Form1.Designer.cs
......\.......\Form1.resx
......\.......\Form2.cs
......\.......\Form2.Designer.cs
......\.......\Form2.resx
......\.......\Form3.cs
......\.......\Form3.Designer.cs
......\.......\lab03sc.csproj
......\.......\lab03sc.csproj.user
......\.......\Program.cs
......\lab03sc.sln
......\lab03sc.suo