О процентах лексики

[RawonaM]

А если скандинавизмы посчитать? Ибо заимствования.

Так это же тоже германцы.

Все равно, не исконна же.

А исконность у вас с какого века считается? Все что в олдинглише уже исконное? Или только то, что проследить невозможно?

[Bhudh]

Чем слова считаешь?

Скорее «что словами считаешь?».

[RawonaM]

102 слова, 12 жабоизмы.

Чем слова считаешь?

wc. Она нормально считает?

[myst]

wc. Она нормально считает?

Я уже забыл, что она считает. У меня awk головного мозга.

[myst]

Надо не так сделать. Берём первую сотню самых частотных слов и смотрим. Потом вторую. Потом... впрочем, ну его нафик, хватит и двух сотен.

[Nevik Xukxo]

А исконность у вас с какого века считается?

Предлагаю считать исконно английской только ту лексику, что приплыла с Хенгистом и Хорсой, но никак не позже.

[RawonaM]

Заапдейтил с учетом комментариев.

bray не проапдейтил.

Пардон.

Ну в общем, на таком маленьком тесте статистику не делают в любом случае, но дело ясное, что процент не более 20 стопудово. Чем "взрослее" текст, тем процент будет увеличиваться.

[myst]

Списки у меня есть. Кто возьмётся?

[RawonaM]

Надо не так сделать. Берём первую сотню самых частотных слов и смотрим. Потом вторую. Потом... впрочем, ну его нафик.

С педии:
Source of the most frequent 7,476 English words
       1st 100    1st 1,000    2nd 1,000    then on
Germanic    97%    57%    39%    36%
Italic    3%    36%    51%    51%
Hellenic    0    4%    4%    7%
Others    0    3%    6%    6%

[Bhudh]

is a data driven programming language designed for processing text-based data, either in files or data streams. It is an example of a programming language that extensively uses the string datatype, associative arrays (that is, arrays indexed by key strings), and regular expressions.

AWK is one of the early tools to appear in Version 7 Unix and gained popularity as a way to add computational features to a Unix pipeline. A version of the AWK language is a standard feature of nearly every modern Unix-like operating system available today. AWK is mentioned in the Single UNIX Specification as one of the mandatory utilities of a Unix operating system. Besides the Bourne shell, AWK is the only other scripting language available in a standard Unix environment. It is also present amongst the commands required by the Linux Standard Base specification. Implementations of AWK exist as installed software for almost all other operating systems.

AWK was created at Bell Labs in the 1970s, and its name is derived from the family names of its authors — Alfred Aho, Peter Weinberger, and Brian Kernighan. The name is not commonly pronounced as a string of separate letters but rather to sound the same as the name of the bird, auk (which acts as an emblem of the language such as on The AWK Programming Language book cover - the book is often referred to by the abbreviation TAPL). awk, when written in all lowercase letters, refers to the Unix or Plan 9 program that runs other programs written in the AWK programming language.

The power, terseness, and limitations of early AWK programs inspired Larry Wall to write Perl just as a new, more powerful POSIX AWK and gawk (GNU AWK) were being defined. Although AWK and sed were designed to support one-liner programs, even the early Bell Labs users of AWK often wrote well-structured large AWK programs.

AWK is Turing-complete.

Structure of AWK programs

"AWK is a language for processing files of text. A file is treated as a sequence of records, and by default each line is a record. Each line is broken up into a sequence of fields, so we can think of the first word in a line as the first field, the second word as the second field, and so on. An AWK program is of a sequence of pattern-action statements. AWK reads the input a line at a time. A line is scanned for each pattern in the program, and for each pattern that matches, the associated action is executed." - Alfred V. Aho

An AWK program is a series of pattern action pairs, written as:
condition { action }

where condition is typically an expression and action is a series of commands. The input is split into records, where by default records are separated by newline characters so that the input is split into lines. The program tests each record against each of the conditions in turn, and executes the action for each expression that is true. Either the condition or the action may be omitted. The condition defaults to matching every record. The default action is to print the record.

In addition to a simple AWK expression, such as foo == 1 or /^foo/, the condition can be BEGIN or END causing the action to be executed before or after all records have been read, or pattern1, pattern2 which matches the range of records starting with a record that matches pattern1 up to and including the record that matches pattern2 before again trying to match against pattern1 on future lines.

In addition to normal arithmetic and logical operators, AWK expressions include the tilde operator, ~, which matches a regular expression against a string. As handy syntactic sugar, /regexp/ without using the tilde operator matches against the current record.

AWK commands

AWK commands are the statement that is substituted for action in the examples above. AWK commands can include function calls, variable assignments, calculations, or any combination thereof. AWK contains built-in support for many functions; many more are provided by the various flavors of AWK. Also, some flavors support the inclusion of dynamically linked libraries, which can also provide more functions.

For brevity, the enclosing curly braces ( { } ) will be omitted from these examples.

[RawonaM]

Списки у меня есть. Кто возьмётся?

А что там браться? В NLTK закинул, он всю статистику по-взрослому умеет. Да и закидывать не надо, у него все есть. Только не знаю, проставлены ли жабоизмы.

[myst]

Обожаю Интернет: в нём почти всё уже сделано до нас. (Веб-сервер задолбал уже рвать соединения! Только с пятого раза запостил. )

[myst]

is a data driven programming language designed for processing text-based data, either in files or data streams. It is an example of a programming language that extensively uses the string datatype, associative arrays (that is, arrays indexed by key strings), and regular expressions.

AWK is one of the early tools to appear in Version 7 Unix and gained popularity as a way to add computational features to a Unix pipeline. A version of the AWK language is a standard feature of nearly every modern Unix-like operating system available today. AWK is mentioned in the Single UNIX Specification as one of the mandatory utilities of a Unix operating system. Besides the Bourne shell, AWK is the only other scripting language available in a standard Unix environment. It is also present amongst the commands required by the Linux Standard Base specification. Implementations of AWK exist as installed software for almost all other operating systems.

AWK was created at Bell Labs in the 1970s, and its name is derived from the family names of its authors — Alfred Aho, Peter Weinberger, and Brian Kernighan. The name is not commonly pronounced as a string of separate letters but rather to sound the same as the name of the bird, auk (which acts as an emblem of the language such as on The AWK Programming Language book cover - the book is often referred to by the abbreviation TAPL). awk, when written in all lowercase letters, refers to the Unix or Plan 9 program that runs other programs written in the AWK programming language.

The power, terseness, and limitations of early AWK programs inspired Larry Wall to write Perl just as a new, more powerful POSIX AWK and gawk (GNU AWK) were being defined. Although AWK and sed were designed to support one-liner programs, even the early Bell Labs users of AWK often wrote well-structured large AWK programs.

AWK is Turing-complete.

Structure of AWK programs

"AWK is a language for processing files of text. A file is treated as a sequence of records, and by default each line is a record. Each line is broken up into a sequence of fields, so we can think of the first word in a line as the first field, the second word as the second field, and so on. An AWK program is of a sequence of pattern-action statements. AWK reads the input a line at a time. A line is scanned for each pattern in the program, and for each pattern that matches, the associated action is executed." - Alfred V. Aho

An AWK program is a series of pattern action pairs, written as:
condition { action }

where condition is typically an expression and action is a series of commands. The input is split into records, where by default records are separated by newline characters so that the input is split into lines. The program tests each record against each of the conditions in turn, and executes the action for each expression that is true. Either the condition or the action may be omitted. The condition defaults to matching every record. The default action is to print the record.

In addition to a simple AWK expression, such as foo == 1 or /^foo/, the condition can be BEGIN or END causing the action to be executed before or after all records have been read, or pattern1, pattern2 which matches the range of records starting with a record that matches pattern1 up to and including the record that matches pattern2 before again trying to match against pattern1 on future lines.

In addition to normal arithmetic and logical operators, AWK expressions include the tilde operator, ~, which matches a regular expression against a string. As handy syntactic sugar, /regexp/ without using the tilde operator matches against the current record.

AWK commands

AWK commands are the statement that is substituted for action in the examples above. AWK commands can include function calls, variable assignments, calculations, or any combination thereof. AWK contains built-in support for many functions; many more are provided by the various flavors of AWK. Also, some flavors support the inclusion of dynamically linked libraries, which can also provide more functions.

For brevity, the enclosing curly braces ( { } ) will be omitted from these examples.

Ты кэпом в ночь подрабатываешь?

[Bhudh]

А уже ночь⁈ А-а-а! И правда!

А некоторые-то не знают...

[mnashe]

И я не знал.

[RawonaM]

Странные люди.

[Хворост]

А dish, cook, inch считаются?

[mnashe]

С педии:

Чтоб читалось удобнее:
Source of the most frequent 7,476 English words

	1st 100	1st 1,000	2nd 1,000	then on
Germanic	97%	57%	39%	36%
Italic	3%	36%	51%	51%
Hellenic	0	4%	4%	7%
Others	0	3%	6%	6%

[autolyk]

А dish, cook, inch считаются?

Если принять предложение:

Предлагаю считать исконно английской только ту лексику, что приплыла с Хенгистом и Хорсой, но никак не позже.

то считаются германскими, кроме inch.

[Aleksey]

таки срач глуповат.
берете данные корпуса английского языка и радуетесь, как не поглядишь все тут лексикостатисты. епт.

[myst]

таки срач глуповат.

Во-первых, здесь нет никакого срача.

берете данные корпуса английского языка и радуетесь, как не поглядишь все тут лексикостатисты. епт.

Во-вторых, если у Вас есть какие-то дополнительные сведения, приводите. Пустое балабольство здесь никому не интересно.

[Aleksey]

Во-вторых, если у Вас есть какие-то дополнительные сведения, приводите. Пустое балабольство здесь никому не интересно.

был бы рад, но в основном данные корпуса небесплатные..

[злой]

Надо считать исконно английскими только те слова, которые предсказываются методом сравнительного языкознания. Все остальные - не считово.

[Nekto]

Italic    3%    36%    51%    51%

Это чё имеется ввиду? 

[Karakurt]

Латынь и френч вестимо.